Sep 04 15:43:30 devstack cinder-volume[76528]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 04 15:43:30 devstack cinder-volume[76528]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 04 15:43:30 devstack cinder-volume[76528]: we strongly recommend against using it for new projects.
Sep 04 15:43:30 devstack cinder-volume[76528]: If you are already using Eventlet, we recommend migrating to a different
Sep 04 15:43:30 devstack cinder-volume[76528]: framework.  For more detail see
Sep 04 15:43:30 devstack cinder-volume[76528]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 04 15:43:30 devstack cinder-volume[76528]:   import eventlet  # noqa
Sep 04 15:43:33 devstack cinder-volume[76528]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76528) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 04 15:43:33 devstack cinder-volume[76528]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76528) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 04 15:43:33 devstack cinder-volume[76528]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76528) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 04 15:43:34 devstack cinder-volume[76528]: INFO dbcounter [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Registered counter for database cinder
Sep 04 15:43:34 devstack cinder-volume[76528]: DEBUG oslo_db.sqlalchemy.engines [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76528) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 15:43:35 devstack cinder-volume[76528]: DEBUG dbcounter [-] [76528] Writer thread running {{(pid=76528) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 04 15:43:35 devstack cinder-volume[76528]: INFO cinder.rpc [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 04 15:43:35 devstack cinder-volume[76528]: INFO cinder.rpc [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 04 15:43:35 devstack cinder-volume[76528]: DEBUG oslo_db.sqlalchemy.engines [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76528) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 15:43:35 devstack cinder-volume[76528]: INFO cinder.volume.manager [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Determined volume DB was empty at startup.
Sep 04 15:43:35 devstack cinder-volume[76528]: DEBUG cinder.volume.manager [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76528) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 04 15:43:35 devstack cinder-volume[76528]: INFO cinder.volume.manager [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 04 15:43:35 devstack cinder-volume[76528]: WARNING stevedore.named [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 04 15:43:35 devstack cinder-volume[76528]: WARNING castellan.key_manager [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 04 15:43:35 devstack cinder-volume[76528]: WARNING cinder.keymgr.conf_key_mgr [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 04 15:43:35 devstack cinder-volume[76528]: DEBUG cinder.volume.drivers.lvm [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76528) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Sep 04 15:43:35 devstack cinder-volume[76528]: DEBUG oslo_concurrency.processutils [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76528) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:35 devstack cinder-volume[76528]: DEBUG oslo_concurrency.processutils [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] CMD "cinder-rtstool verify" returned: 0 in 0.466s {{(pid=76528) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:35 devstack cinder-volume[76528]: DEBUG oslo_db.sqlalchemy.engines [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76528) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 15:43:35 devstack cinder-volume[76528]: INFO cinder.rpc [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 04 15:43:35 devstack cinder-volume[76528]: INFO cinder.rpc [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 04 15:43:35 devstack cinder-volume[76528]: WARNING stevedore.named [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 04 15:43:35 devstack cinder-volume[76528]: WARNING castellan.key_manager [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 04 15:43:35 devstack cinder-volume[76528]: INFO cinder.volume.manager [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 04 15:43:35 devstack cinder-volume[76528]: DEBUG oslo_db.sqlalchemy.engines [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76528) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 15:43:35 devstack cinder-volume[76528]: INFO oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Starting 1 workers
Sep 04 15:43:35 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Started child 76696 {{(pid=76528) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 04 15:43:35 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Full set of CONF: {{(pid=76528) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 04 15:43:35 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] ******************************************************************************** {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 04 15:43:35 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Configuration options gathered from: {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 04 15:43:35 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 04 15:43:35 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 04 15:43:35 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] ================================================================================ {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 04 15:43:35 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] allow_availability_zone_fallback = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:35 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] allow_compression_on_image_upload = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:35 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] allowed_direct_url_schemes     = [] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:35 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] api_rate_limit                 = True {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:35 devstack cinder-volume[76696]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] auth_strategy                  = keystone {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] az_cache_duration              = 3600 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_availability_zone      = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_host                   = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_name                   = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_stats_polling_interval = 60 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backup_api_class               = cinder.backup.api.API {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backup_name_template           = backup-%s {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backup_use_same_host           = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backup_use_temp_snapshot       = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] chap_password                  = **** {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] chap_username                  =  {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cinder_internal_tenant_project_id = c7bf635b1e244a53bd583343ef19d36d {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cinder_internal_tenant_user_id = 04d520aeca1f462e82a1001b21299fe8 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cloned_volume_same_az          = True {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cluster                        = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] compression_format             = gzip {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] compute_api_class              = cinder.compute.nova.API {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] config_dir                     = [] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] config_source                  = [] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] control_exchange               = openstack {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] debug                          = True {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] default_availability_zone      = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] default_group_type             = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] default_volume_type            = lvmdriver-1 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] disk_geometry                  = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] driver_client_cert             = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] driver_client_cert_key         = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] driver_data_namespace          = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] driver_ssl_cert_path           = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] driver_ssl_cert_verify         = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] driver_use_ssl                 = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] enable_force_upload            = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] enable_new_services            = True {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] enable_unsupported_driver      = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] enforce_multipath_for_image_xfer = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] filter_function                = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] glance_api_insecure            = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] glance_api_servers             = ['http://192.168.122.126/image'] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] glance_api_ssl_compression     = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] glance_ca_certificates_file    = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] glance_catalog_info            = image:glance:publicURL {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] glance_certfile                = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] glance_keyfile                 = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] glance_num_retries             = 3 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] glance_request_timeout         = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] goodness_function              = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] graceful_shutdown_timeout      = 5 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] group_api_class                = cinder.group.api.API {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] host                           = devstack {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] image_compress_on_upload       = True {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] image_conversion_address_space_limit = 1 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] image_conversion_cpu_limit     = 60 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] image_conversion_disable       = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] image_upload_use_cinder_backend = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] image_upload_use_internal_tenant = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] image_volume_cache_enabled     = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] image_volume_cache_max_count   = 0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] image_volume_cache_max_size_gb = 0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] init_host_max_objects_retrieval = 0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] instance_format                = [instance: %(uuid)s]  {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] iscsi_target_flags             =  {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] iscsi_write_cache              = on {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] iser_helper                    = tgtadm {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] iser_ip_address                = 192.168.122.126 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] iser_port                      = 3260 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] log_color                      = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] log_config_append              = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] log_dir                        = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] log_file                       = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] log_options                    = True {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] log_rotate_interval            = 1 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] log_rotate_interval_type       = days {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] log_rotation_type              = none {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] max_age                        = 0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] max_logfile_count              = 30 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] max_logfile_size_mb            = 200 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] max_over_subscription_ratio    = 20.0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] message_reap_interval          = 86400 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] message_ttl                    = 2592000 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76696]: INFO cinder.volume.manager [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 04 15:43:36 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] migration_create_volume_timeout_secs = 300 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] monkey_patch                   = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] monkey_patch_modules           = [] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] my_ip                          = 192.168.122.126 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] no_snapshot_gb_quota           = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] num_iser_scan_tries            = 3 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] num_shell_tries                = 3 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] num_volume_device_scan_tries   = 3 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] nvmeof_conn_info_version       = 1 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] nvmet_ns_id                    = 10 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] nvmet_port_id                  = 1 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] osapi_max_limit                = 1000 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] osapi_volume_ext_list          = [] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] osapi_volume_listen_port       = 8776 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] osapi_volume_use_ssl           = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] osapi_volume_workers           = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] per_volume_size_limit          = -1 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] periodic_fuzzy_delay           = 60 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] periodic_interval              = 60 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] public_endpoint                = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] publish_errors                 = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] quota_backup_gigabytes         = 1000 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] quota_backups                  = 10 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] quota_gigabytes                = 1000 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] quota_groups                   = 10 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] quota_snapshots                = 10 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] quota_volumes                  = 10 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] rate_limit_burst               = 0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] rate_limit_except_level        = CRITICAL {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] rate_limit_interval            = 0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] reinit_driver_count            = 3 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] replication_device             = **** {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] report_discard_supported       = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] report_interval                = 120 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] reservation_clean_interval     = 86400 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] reservation_expire             = 86400 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] reserved_image_namespaces      = [] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] reserved_percentage            = 0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] rpc_response_timeout           = 120 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] run_external_periodic_tasks    = True {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] scst_target_driver             = iscsi {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] scst_target_iqn_name           = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] service_down_time              = 720 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] shell_completion               = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] snapshot_name_template         = snapshot-%s {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] snapshot_same_host             = True {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] split_loggers                  = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] state_path                     = /opt/stack/data/cinder {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] storage_availability_zone      = nova {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] storage_protocol               = iSCSI {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] syslog_log_facility            = LOG_USER {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.058s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] target_helper                  = lioadm {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] target_ip_address              = 192.168.122.126 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] target_port                    = 3260 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] target_protocol                = iscsi {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] target_secondary_ip_addresses  = [] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] trace_flags                    = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] transport_url                  = **** {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] until_refresh                  = 0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] use_chap_auth                  = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] use_default_quota_class        = True {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] use_journal                    = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] use_json                       = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] use_multipath_for_image_xfer   = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] use_stderr                     = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] use_syslog                     = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] verify_glance_signatures       = enabled {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] volume_api_class               = cinder.volume.api.API {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] volume_backend_name            = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] volume_clear                   = zero {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] volume_clear_ionice            = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] volume_clear_size              = 0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] volume_copy_bps_limit          = 0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] volume_dd_blocksize            = 1M {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] volume_name_template           = volume-%s {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] volume_service_inithost_offload = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] volume_usage_audit_period      = month {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] zoning_mode                    = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_concurrency.disable_process_locking = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.auth_section = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.auth_type   = password {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.auth_version = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.cache       = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.certfile    = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.delay_auth_decision = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.http_connect_timeout = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.include_service_catalog = True {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.insecure    = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.interface   = public {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.keyfile     = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:36 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.memcache_password = **** {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.memcache_username = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.region_name = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.service_token_roles_required = True {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.service_type = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.token_cache_time = 300 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.126/identity {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.backend                  = dogpile.cache.null {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.backend_argument         = **** {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.backend_expiration_time  = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.config_prefix            = cache.oslo {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.debug_cache_backend      = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.enable_retry_client      = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.enable_socket_keepalive  = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.enabled                  = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.expiration_time          = 600 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.hashclient_retry_attempts = 2 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.memcache_dead_retry      = 300 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.memcache_pool_maxsize    = 10 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.memcache_sasl_enabled    = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.password                 = **** {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.proxies                  = [] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.redis_db                 = 0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.redis_sentinel_service_name = mymaster {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.redis_server             = localhost:6379 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.retry_attempts           = 2 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.retry_delay              = 0.0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.socket_keepalive_count   = 1 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.socket_keepalive_idle    = 1 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.socket_keepalive_interval = 1 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.socket_timeout           = 1.0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.tls_allowed_ciphers      = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.tls_cafile               = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.tls_certfile             = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.tls_enabled              = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.tls_keyfile              = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cache.username                 = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] coordination.backend_url       = **** {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] database.asyncio_connection    = **** {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] database.asyncio_slave_connection = **** {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] database.backend               = sqlalchemy {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] database.connection            = **** {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] database.connection_debug      = 0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] database.connection_parameters =  {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] database.connection_recycle_time = 3600 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] database.connection_trace      = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] database.db_inc_retry_interval = True {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] database.db_max_retries        = 20 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] database.db_max_retry_interval = 10 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] database.db_retry_interval     = 1 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] database.max_overflow          = 50 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] database.max_pool_size         = 5 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] database.max_retries           = 10 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] database.mysql_wsrep_sync_wait = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] database.pool_timeout          = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] database.retry_interval        = 10 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] database.slave_connection      = **** {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] database.sqlite_synchronous    = True {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] database.synchronous_reader    = True {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] database.use_db_reconnect      = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_tracing.insecure = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] profiler.connection_string     = messaging:// {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] profiler.enabled               = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] profiler.es_doc_type           = notification {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] profiler.es_scroll_size        = 10000 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] profiler.es_scroll_time        = 2m {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] profiler.filter_error_trace    = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] profiler.hmac_keys             = **** {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] profiler.sentinel_service_name = mymaster {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] profiler.socket_timeout        = 0.1 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] profiler.trace_requests        = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] profiler.trace_sqlalchemy      = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] profiler_jaeger.process_tags   = {} {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] profiler_jaeger.service_name_prefix = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] profiler_otlp.service_name_prefix = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_policy.enforce_new_defaults = True {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_policy.policy_default_rule = default {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_policy.policy_file        = policy.yaml {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] privsep_osbrick.group          = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] privsep_osbrick.helper_command = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack sudo[76700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 04 15:43:36 devstack sudo[76700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] privsep_osbrick.user           = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cinder_sys_admin.group         = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cinder_sys_admin.helper_command = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] cinder_sys_admin.user          = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] service_user.auth_section      = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] service_user.auth_type         = password {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] service_user.cafile            = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] service_user.certfile          = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] service_user.collect_timing    = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] service_user.insecure          = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] service_user.keyfile           = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] service_user.send_service_user_token = True {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] service_user.split_loggers     = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] service_user.timeout           = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] service_user.tls_ciphers       = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] service_user.tls_min_version   = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] glance.auth_section            = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] glance.auth_type               = password {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] glance.certfile                = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] glance.collect_timing          = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] glance.insecure                = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] glance.keyfile                 = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] glance.region_name             = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] glance.split_loggers           = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] glance.timeout                 = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] glance.tls_ciphers             = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] glance.tls_min_version         = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.backend_availability_zone = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.chap_password = **** {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.chap_username =  {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.disk_geometry = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.driver_client_cert = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.driver_client_cert_key = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.driver_data_namespace = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.driver_use_ssl = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.enable_unsupported_driver = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.extra_capabilities = {} {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.filter_function = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.goodness_function = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.iscsi_target_flags =  {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.iscsi_write_cache = on {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.iser_helper   = tgtadm {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.iser_ip_address = 192.168.122.126 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.iser_port     = 3260 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.lvm_share_target = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.lvm_type      = auto {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.num_shell_tries = 3 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.nvmet_port_id = 1 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.replication_device = **** {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.report_discard_supported = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.reserved_percentage = 0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.scst_target_driver = iscsi {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.scst_target_iqn_name = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.storage_protocol = iSCSI {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.target_helper = tgtadm {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.target_ip_address = 192.168.122.126 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.target_port   = 3260 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.target_protocol = iscsi {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.trace_flags   = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.unique_fqdn_network = True {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.use_chap_auth = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.volume_backend_name = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.volume_clear  = zero {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.volume_clear_ionice = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.volume_clear_size = 0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_reports.file_event_handler = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_reports.log_dir           = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.backend_availability_zone = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.backend_host       = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.chap_password      = **** {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.chap_username      = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.disk_geometry      = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.driver_client_cert = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.driver_data_namespace = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.extra_capabilities = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.filter_function    = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.goodness_function  = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.iser_helper        = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.iser_ip_address    = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.iser_port          = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.iser_target_prefix = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.lvm_share_target   = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.lvm_type           = auto {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.num_shell_tries    = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.replication_device = **** {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.report_discard_supported = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.reserved_percentage = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.scst_target_driver = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.storage_protocol   = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.target_helper      = lioadm {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.target_ip_address  = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.target_port        = 3260 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.trace_flags        = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.use_chap_auth      = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.volume_clear       = zero {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.volume_clear_size  = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] lvmdriver-1.volumes_dir        = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.ssl      = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_notifications.driver = [] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_notifications.retry = -1 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] oslo_messaging_notifications.transport_url = **** {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] key_manager.fixed_key          = **** {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican.barbican_api_version  = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican.barbican_endpoint     = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican.barbican_endpoint_type = public {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican.barbican_region_name  = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican.cafile                = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican.certfile              = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican.collect_timing        = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican.insecure              = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican.keyfile               = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican.number_of_retries     = 60 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican.retry_delay           = 1 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican.send_service_user_token = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican.split_loggers         = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican.timeout               = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican.tls_ciphers           = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican.tls_min_version       = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican.verify_ssl            = True {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican.verify_ssl_path       = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican_service_user.auth_section = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican_service_user.auth_type = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican_service_user.cafile   = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican_service_user.certfile = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican_service_user.collect_timing = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican_service_user.insecure = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican_service_user.keyfile  = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican_service_user.split_loggers = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican_service_user.timeout  = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican_service_user.tls_ciphers = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] barbican_service_user.tls_min_version = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] vault.approle_role_id          = **** {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] vault.approle_secret_id        = **** {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] vault.auth_method              = approle {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] vault.auth_path                = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] vault.kv_mountpoint            = secret {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] vault.kv_path                  = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] vault.kv_version               = 2 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] vault.namespace                = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] vault.root_token_id            = **** {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] vault.ssl_ca_crt_file          = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] vault.timeout                  = 60.0 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] vault.token_file               = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] vault.token_role               = None {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] vault.use_ssl                  = False {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:43:36 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] ******************************************************************************** {{(pid=76528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 04 15:43:36 devstack sudo[76700]: pam_unix(sudo:session): session closed for user root
Sep 04 15:43:36 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.424s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:36 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:36 devstack sudo[76825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 04 15:43:36 devstack sudo[76825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:43:37 devstack sudo[76825]: pam_unix(sudo:session): session closed for user root
Sep 04 15:43:37 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.347s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:37 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 15:43:37 devstack cinder-volume[76696]: INFO cinder.brick.local_dev.lvm [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 04 15:43:37 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:37 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:37 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:37 devstack sudo[76921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 04 15:43:37 devstack sudo[76921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:43:37 devstack sudo[76921]: pam_unix(sudo:session): session closed for user root
Sep 04 15:43:37 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:37 devstack cinder-volume[76696]: DEBUG cinder.brick.local_dev.lvm [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76696) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Sep 04 15:43:37 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:37 devstack sudo[76992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 04 15:43:37 devstack sudo[76992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:43:37 devstack sudo[76992]: pam_unix(sudo:session): session closed for user root
Sep 04 15:43:37 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.514s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:37 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:37 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:37 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:37 devstack sudo[77177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 04 15:43:37 devstack sudo[77177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:43:38 devstack sudo[77177]: pam_unix(sudo:session): session closed for user root
Sep 04 15:43:38 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:38 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:38 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:38 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:38 devstack sudo[77300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 04 15:43:38 devstack sudo[77300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:43:38 devstack sudo[77300]: pam_unix(sudo:session): session closed for user root
Sep 04 15:43:38 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.271s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:38 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:38 devstack sudo[77312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 04 15:43:38 devstack sudo[77312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:43:38 devstack sudo[77312]: pam_unix(sudo:session): session closed for user root
Sep 04 15:43:38 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:38 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:38 devstack sudo[77391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 04 15:43:38 devstack sudo[77391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:43:39 devstack sudo[77391]: pam_unix(sudo:session): session closed for user root
Sep 04 15:43:39 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:39 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:39 devstack sudo[77399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 15:43:39 devstack sudo[77399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:43:39 devstack sudo[77399]: pam_unix(sudo:session): session closed for user root
Sep 04 15:43:39 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:39 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:39 devstack sudo[77414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 04 15:43:39 devstack sudo[77414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:43:39 devstack sudo[77414]: pam_unix(sudo:session): session closed for user root
Sep 04 15:43:39 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:39 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:39 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:39 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:39 devstack sudo[77470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 04 15:43:39 devstack sudo[77470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:43:39 devstack sudo[77470]: pam_unix(sudo:session): session closed for user root
Sep 04 15:43:39 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:39 devstack cinder-volume[76696]: INFO cinder.volume.drivers.lvm [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 04 15:43:39 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:39 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:39 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:39 devstack sudo[77502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 04 15:43:39 devstack sudo[77502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:43:40 devstack sudo[77502]: pam_unix(sudo:session): session closed for user root
Sep 04 15:43:40 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:40 devstack cinder-volume[76696]: DEBUG cinder.volume.drivers.lvm [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Updating volume stats {{(pid=76696) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 04 15:43:40 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:40 devstack sudo[77505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 04 15:43:40 devstack sudo[77505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:43:40 devstack sudo[77505]: pam_unix(sudo:session): session closed for user root
Sep 04 15:43:40 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:40 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:40 devstack sudo[77508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 15:43:40 devstack sudo[77508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:43:40 devstack sudo[77508]: pam_unix(sudo:session): session closed for user root
Sep 04 15:43:40 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:40 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:40 devstack sudo[77511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 04 15:43:40 devstack sudo[77511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:43:40 devstack sudo[77511]: pam_unix(sudo:session): session closed for user root
Sep 04 15:43:40 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:40 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:40 devstack sudo[77514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 15:43:40 devstack sudo[77514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:43:41 devstack sudo[77514]: pam_unix(sudo:session): session closed for user root
Sep 04 15:43:41 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:41 devstack cinder-volume[76696]: INFO cinder.volume.driver [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Driver hasn't implemented _init_vendor_properties()
Sep 04 15:43:41 devstack cinder-volume[76696]: DEBUG cinder.volume.driver [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76696) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 04 15:43:41 devstack cinder-volume[76696]: DEBUG oslo_db.sqlalchemy.engines [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76696) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 15:43:41 devstack cinder-volume[76696]: DEBUG dbcounter [-] [76696] Writer thread running {{(pid=76696) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 04 15:43:41 devstack cinder-volume[76696]: DEBUG cinder.db.api [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Building query based on filter {{(pid=76696) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 04 15:43:41 devstack cinder-volume[76696]: DEBUG cinder.image.image_utils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76696) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 04 15:43:41 devstack cinder-volume[76696]: INFO cinder.keymgr.migration [None req-847b2d15-34f9-4662-8747-af9920868054 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 04 15:43:41 devstack cinder-volume[76696]: DEBUG cinder.volume.drivers.lvm [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Updating volume stats {{(pid=76696) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 04 15:43:41 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:41 devstack sudo[77517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 04 15:43:41 devstack sudo[77517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:43:41 devstack sudo[77517]: pam_unix(sudo:session): session closed for user root
Sep 04 15:43:41 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:41 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:41 devstack sudo[77520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 15:43:41 devstack sudo[77520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:43:41 devstack sudo[77520]: pam_unix(sudo:session): session closed for user root
Sep 04 15:43:41 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:41 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:41 devstack sudo[77525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 04 15:43:41 devstack sudo[77525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:43:42 devstack sudo[77525]: pam_unix(sudo:session): session closed for user root
Sep 04 15:43:42 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:42 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:42 devstack sudo[77528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 15:43:42 devstack sudo[77528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:43:42 devstack sudo[77528]: pam_unix(sudo:session): session closed for user root
Sep 04 15:43:42 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:42 devstack cinder-volume[76696]: DEBUG cinder.manager [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Notifying Schedulers of capabilities ... {{(pid=76696) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:43:42 devstack cinder-volume[76696]: INFO cinder.volume.manager [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Driver initialization completed successfully.
Sep 04 15:43:42 devstack cinder-volume[76696]: INFO cinder.manager [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Initiating service 2 cleanup
Sep 04 15:43:42 devstack cinder-volume[76696]: INFO cinder.manager [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Service 2 cleanup completed.
Sep 04 15:43:42 devstack cinder-volume[76696]: DEBUG cinder.service [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Creating RPC server for service cinder-volume {{(pid=76696) start /opt/stack/cinder/cinder/service.py:231}}
Sep 04 15:43:42 devstack cinder-volume[76696]: DEBUG cinder.service [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76696) start /opt/stack/cinder/cinder/service.py:237}}
Sep 04 15:43:42 devstack cinder-volume[76696]: INFO cinder.volume.manager [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 04 15:43:42 devstack cinder-volume[76696]: DEBUG cinder.volume.drivers.lvm [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Updating volume stats {{(pid=76696) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 04 15:43:42 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:42 devstack sudo[77535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 04 15:43:42 devstack sudo[77535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:43:42 devstack sudo[77535]: pam_unix(sudo:session): session closed for user root
Sep 04 15:43:42 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:42 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:42 devstack sudo[77538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 15:43:42 devstack sudo[77538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:43:43 devstack sudo[77538]: pam_unix(sudo:session): session closed for user root
Sep 04 15:43:43 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:43 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:43 devstack sudo[77543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 04 15:43:43 devstack sudo[77543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:43:43 devstack sudo[77543]: pam_unix(sudo:session): session closed for user root
Sep 04 15:43:43 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:43 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:43:43 devstack sudo[77547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 15:43:43 devstack sudo[77547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:43:43 devstack sudo[77547]: pam_unix(sudo:session): session closed for user root
Sep 04 15:43:43 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:43:43 devstack cinder-volume[76696]: INFO cinder.volume.manager [None req-68241b0c-04bf-4581-b869-e6729bc8f005 None None] Driver post RPC initialization completed successfully.
Sep 04 15:43:45 devstack cinder-volume[76528]: DEBUG dbcounter [-] [76528] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76528) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:43:53 devstack cinder-volume[76696]: DEBUG dbcounter [-] [76696] Writing DB stats cinder:SELECT=3 {{(pid=76696) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:43:53 devstack cinder-volume[76696]: DEBUG dbcounter [-] [76696] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76696) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:44:10 devstack cinder-volume[76696]: DEBUG oslo_service.periodic_task [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] Running periodic task VolumeManager._thread_info {{(pid=76696) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:44:10 devstack cinder-volume[76696]: DEBUG cinder.volume.manager [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] thread count: 6 {{(pid=76696) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 15:44:10 devstack cinder-volume[76696]: DEBUG cinder.volume.manager [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] thread info: [<_MainThread(MainThread, started 133281905156224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133281803675776)>, <Thread(Thread-3 (stat_writer), started daemon 133281791276928)>, <Thread(Rabbit-heartbeat, started daemon 133281789503872)>, <Thread(Thread-5 (_runner), started daemon 133281790086784)>, <Thread(Thread-7 (_runner), started daemon 133281790235520)>] {{(pid=76696) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 15:45:10 devstack cinder-volume[76696]: DEBUG oslo_service.periodic_task [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76696) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:45:10 devstack cinder-volume[76696]: DEBUG cinder.volume.drivers.lvm [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] Updating volume stats {{(pid=76696) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 04 15:45:10 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:45:10 devstack sudo[80226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 04 15:45:10 devstack sudo[80226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:45:10 devstack sudo[80226]: pam_unix(sudo:session): session closed for user root
Sep 04 15:45:10 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:45:10 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:45:10 devstack sudo[80408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 15:45:10 devstack sudo[80408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:45:11 devstack sudo[80408]: pam_unix(sudo:session): session closed for user root
Sep 04 15:45:11 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:45:11 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:45:11 devstack sudo[80586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 04 15:45:11 devstack sudo[80586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:45:11 devstack sudo[80586]: pam_unix(sudo:session): session closed for user root
Sep 04 15:45:11 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:45:11 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:45:11 devstack sudo[80776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 15:45:11 devstack sudo[80776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:45:11 devstack sudo[80776]: pam_unix(sudo:session): session closed for user root
Sep 04 15:45:11 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:45:11 devstack cinder-volume[76696]: DEBUG cinder.manager [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] Notifying Schedulers of capabilities ... {{(pid=76696) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:45:11 devstack cinder-volume[76696]: DEBUG oslo_service.periodic_task [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] Running periodic task VolumeManager._thread_info {{(pid=76696) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:45:11 devstack cinder-volume[76696]: DEBUG cinder.volume.manager [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] thread count: 6 {{(pid=76696) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 15:45:11 devstack cinder-volume[76696]: DEBUG cinder.volume.manager [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] thread info: [<_MainThread(MainThread, started 133281905156224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133281803675776)>, <Thread(Thread-3 (stat_writer), started daemon 133281791276928)>, <Thread(Rabbit-heartbeat, started daemon 133281789503872)>, <Thread(Thread-5 (_runner), started daemon 133281790086784)>, <Thread(Thread-7 (_runner), started daemon 133281790235520)>] {{(pid=76696) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 15:45:53 devstack cinder-volume[76696]: DEBUG dbcounter [-] [76696] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76696) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:46:10 devstack cinder-volume[76696]: DEBUG oslo_service.periodic_task [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76696) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:46:10 devstack cinder-volume[76696]: DEBUG cinder.volume.drivers.lvm [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] Updating volume stats {{(pid=76696) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 04 15:46:10 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:46:10 devstack sudo[84045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 04 15:46:10 devstack sudo[84045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:46:10 devstack sudo[84045]: pam_unix(sudo:session): session closed for user root
Sep 04 15:46:10 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:46:10 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:46:10 devstack sudo[84064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 15:46:10 devstack sudo[84064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:46:11 devstack sudo[84064]: pam_unix(sudo:session): session closed for user root
Sep 04 15:46:11 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:46:11 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:46:11 devstack sudo[84084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 04 15:46:11 devstack sudo[84084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:46:11 devstack sudo[84084]: pam_unix(sudo:session): session closed for user root
Sep 04 15:46:11 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:46:11 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:46:11 devstack sudo[84112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 15:46:11 devstack sudo[84112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:46:11 devstack sudo[84112]: pam_unix(sudo:session): session closed for user root
Sep 04 15:46:11 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.235s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:46:11 devstack cinder-volume[76696]: DEBUG cinder.manager [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] Notifying Schedulers of capabilities ... {{(pid=76696) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:46:11 devstack cinder-volume[76696]: DEBUG oslo_service.periodic_task [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] Running periodic task VolumeManager._thread_info {{(pid=76696) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:46:11 devstack cinder-volume[76696]: DEBUG cinder.volume.manager [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] thread count: 6 {{(pid=76696) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 15:46:11 devstack cinder-volume[76696]: DEBUG cinder.volume.manager [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] thread info: [<_MainThread(MainThread, started 133281905156224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133281803675776)>, <Thread(Thread-3 (stat_writer), started daemon 133281791276928)>, <Thread(Rabbit-heartbeat, started daemon 133281789503872)>, <Thread(Thread-5 (_runner), started daemon 133281790086784)>, <Thread(Thread-7 (_runner), started daemon 133281790235520)>] {{(pid=76696) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 15:47:10 devstack cinder-volume[76696]: DEBUG oslo_service.periodic_task [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76696) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:47:10 devstack cinder-volume[76696]: DEBUG cinder.volume.drivers.lvm [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] Updating volume stats {{(pid=76696) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 04 15:47:10 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:47:10 devstack sudo[85572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 04 15:47:10 devstack sudo[85572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:47:10 devstack sudo[85572]: pam_unix(sudo:session): session closed for user root
Sep 04 15:47:10 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:47:10 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:47:10 devstack sudo[85593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 15:47:10 devstack sudo[85593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:47:11 devstack sudo[85593]: pam_unix(sudo:session): session closed for user root
Sep 04 15:47:11 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:47:11 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:47:11 devstack sudo[85615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 04 15:47:11 devstack sudo[85615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:47:11 devstack sudo[85615]: pam_unix(sudo:session): session closed for user root
Sep 04 15:47:11 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:47:11 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:47:11 devstack sudo[85618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 15:47:11 devstack sudo[85618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:47:11 devstack sudo[85618]: pam_unix(sudo:session): session closed for user root
Sep 04 15:47:11 devstack cinder-volume[76696]: DEBUG oslo_concurrency.processutils [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:47:11 devstack cinder-volume[76696]: DEBUG cinder.manager [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] Notifying Schedulers of capabilities ... {{(pid=76696) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:47:11 devstack cinder-volume[76696]: DEBUG oslo_service.periodic_task [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] Running periodic task VolumeManager._thread_info {{(pid=76696) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:47:11 devstack cinder-volume[76696]: DEBUG cinder.volume.manager [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] thread count: 6 {{(pid=76696) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 15:47:11 devstack cinder-volume[76696]: DEBUG cinder.volume.manager [None req-1b190a1f-9ebc-4032-b8db-a34a955f34f8 None None] thread info: [<_MainThread(MainThread, started 133281905156224)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133281803675776)>, <Thread(Thread-3 (stat_writer), started daemon 133281791276928)>, <Thread(Rabbit-heartbeat, started daemon 133281789503872)>, <Thread(Thread-5 (_runner), started daemon 133281790086784)>, <Thread(Thread-7 (_runner), started daemon 133281790235520)>] {{(pid=76696) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 15:47:53 devstack cinder-volume[76696]: DEBUG dbcounter [-] [76696] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76696) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:48:04 devstack cinder-volume[76528]: INFO oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Caught SIGTERM, stopping children
Sep 04 15:48:04 devstack cinder-volume[76528]: DEBUG oslo_concurrency.lockutils [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Acquiring lock "singleton_lock" {{(pid=76528) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 04 15:48:04 devstack cinder-volume[76528]: DEBUG oslo_concurrency.lockutils [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Acquired lock "singleton_lock" {{(pid=76528) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 04 15:48:04 devstack cinder-volume[76528]: DEBUG oslo_concurrency.lockutils [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Releasing lock "singleton_lock" {{(pid=76528) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 04 15:48:04 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Stop services. {{(pid=76528) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 04 15:48:04 devstack cinder-volume[76528]: DEBUG oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Killing children. {{(pid=76528) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 04 15:48:04 devstack cinder-volume[76528]: INFO oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Waiting on 1 children to exit
Sep 04 15:48:07 devstack cinder-volume[76696]: DEBUG oslo_concurrency.lockutils [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Acquiring lock "singleton_lock" {{(pid=76696) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 04 15:48:07 devstack cinder-volume[76696]: DEBUG oslo_concurrency.lockutils [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Acquired lock "singleton_lock" {{(pid=76696) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 04 15:48:07 devstack cinder-volume[76696]: DEBUG oslo_concurrency.lockutils [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Releasing lock "singleton_lock" {{(pid=76696) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 04 15:48:07 devstack cinder-volume[76696]: WARNING amqp [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 04 15:48:07 devstack cinder-volume[76696]: WARNING amqp [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 04 15:48:07 devstack cinder-volume[76528]: INFO oslo_service.backend._eventlet.service [None req-ae10adee-d3dd-413a-be17-5ca15f3147bf None None] Child 76696 exited with status 0
Sep 04 15:48:07 devstack cinder-volume[86710]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 04 15:48:07 devstack cinder-volume[86710]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 04 15:48:07 devstack cinder-volume[86710]: we strongly recommend against using it for new projects.
Sep 04 15:48:07 devstack cinder-volume[86710]: If you are already using Eventlet, we recommend migrating to a different
Sep 04 15:48:07 devstack cinder-volume[86710]: framework.  For more detail see
Sep 04 15:48:07 devstack cinder-volume[86710]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 04 15:48:07 devstack cinder-volume[86710]:   import eventlet  # noqa
Sep 04 15:48:10 devstack cinder-volume[86710]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86710) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 04 15:48:10 devstack cinder-volume[86710]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86710) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 04 15:48:10 devstack cinder-volume[86710]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86710) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 04 15:48:10 devstack cinder-volume[86710]: INFO dbcounter [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Registered counter for database cinder
Sep 04 15:48:10 devstack cinder-volume[86710]: DEBUG oslo_db.sqlalchemy.engines [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86710) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG dbcounter [-] [86710] Writer thread running {{(pid=86710) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 04 15:48:11 devstack cinder-volume[86710]: INFO cinder.rpc [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 04 15:48:11 devstack cinder-volume[86710]: INFO cinder.rpc [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_db.sqlalchemy.engines [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86710) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 15:48:11 devstack cinder-volume[86710]: INFO cinder.volume.manager [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Determined volume DB was empty at startup.
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG cinder.volume.manager [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86710) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 04 15:48:11 devstack cinder-volume[86710]: INFO cinder.volume.manager [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 04 15:48:11 devstack cinder-volume[86710]: WARNING stevedore.named [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 04 15:48:11 devstack cinder-volume[86710]: WARNING castellan.key_manager [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 04 15:48:11 devstack cinder-volume[86710]: WARNING cinder.keymgr.conf_key_mgr [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 04 15:48:11 devstack cinder-volume[86710]: INFO cinder.volume.manager [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_db.sqlalchemy.engines [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86710) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 15:48:11 devstack cinder-volume[86710]: INFO oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Starting 1 workers
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Started child 86926 {{(pid=86710) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Full set of CONF: {{(pid=86710) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] ******************************************************************************** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Configuration options gathered from: {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] ================================================================================ {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] allow_availability_zone_fallback = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] allow_compression_on_image_upload = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] allowed_direct_url_schemes     = [] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] api_rate_limit                 = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] auth_strategy                  = keystone {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_availability_zone      = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_host                   = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_name                   = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_stats_polling_interval = 60 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backup_api_class               = cinder.backup.api.API {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backup_name_template           = backup-%s {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backup_use_same_host           = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backup_use_temp_snapshot       = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] chap_password                  = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] chap_username                  =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cinder_internal_tenant_project_id = c7bf635b1e244a53bd583343ef19d36d {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cinder_internal_tenant_user_id = 04d520aeca1f462e82a1001b21299fe8 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cluster                        = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] compression_format             = gzip {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] config_dir                     = [] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] config_source                  = [] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] control_exchange               = openstack {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] debug                          = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] default_availability_zone      = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] default_group_type             = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] default_volume_type            = QuobyteHD {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] disk_geometry                  = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] driver_client_cert             = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] driver_client_cert_key         = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] driver_data_namespace          = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86926]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] driver_ssl_cert_path           = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] driver_ssl_cert_verify         = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] driver_use_ssl                 = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] enable_new_services            = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] enable_unsupported_driver      = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] enforce_multipath_for_image_xfer = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] filter_function                = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] glance_api_insecure            = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] glance_api_servers             = ['http://192.168.122.126/image'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] glance_api_ssl_compression     = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] glance_ca_certificates_file    = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] glance_certfile                = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] glance_keyfile                 = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] glance_num_retries             = 3 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] glance_request_timeout         = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] goodness_function              = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] graceful_shutdown_timeout      = 5 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] group_api_class                = cinder.group.api.API {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] host                           = devstack {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] image_compress_on_upload       = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] image_conversion_address_space_limit = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] image_conversion_cpu_limit     = 60 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] image_conversion_disable       = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] image_upload_use_cinder_backend = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] image_upload_use_internal_tenant = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] image_volume_cache_enabled     = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] image_volume_cache_max_count   = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] image_volume_cache_max_size_gb = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] init_host_max_objects_retrieval = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] iscsi_target_flags             =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] iscsi_write_cache              = on {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] iser_helper                    = tgtadm {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] iser_ip_address                = 192.168.122.126 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] iser_port                      = 3260 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] log_color                      = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] log_config_append              = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] log_dir                        = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] log_file                       = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] log_options                    = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] log_rotate_interval            = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] log_rotate_interval_type       = days {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] log_rotation_type              = none {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] max_age                        = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] max_logfile_count              = 30 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] max_logfile_size_mb            = 200 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] max_over_subscription_ratio    = 20.0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] message_reap_interval          = 86400 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] message_ttl                    = 2592000 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] migration_create_volume_timeout_secs = 300 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] monkey_patch                   = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] monkey_patch_modules           = [] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] my_ip                          = 192.168.122.126 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] no_snapshot_gb_quota           = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] num_iser_scan_tries            = 3 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] num_shell_tries                = 3 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] num_volume_device_scan_tries   = 3 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] nvmeof_conn_info_version       = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] nvmet_ns_id                    = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] nvmet_port_id                  = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] osapi_max_limit                = 1000 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] osapi_volume_ext_list          = [] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] osapi_volume_listen_port       = 8776 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] osapi_volume_use_ssl           = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] osapi_volume_workers           = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] per_volume_size_limit          = -1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] periodic_fuzzy_delay           = 60 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] periodic_interval              = 60 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] public_endpoint                = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] publish_errors                 = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] quota_backup_gigabytes         = 1000 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] quota_backups                  = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] quota_gigabytes                = 1000 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] quota_groups                   = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] quota_snapshots                = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] quota_volumes                  = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] rate_limit_burst               = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] rate_limit_except_level        = CRITICAL {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] rate_limit_interval            = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] reinit_driver_count            = 3 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] replication_device             = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] report_discard_supported       = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] report_interval                = 120 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] reservation_clean_interval     = 86400 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] reservation_expire             = 86400 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] reserved_image_namespaces      = [] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] reserved_percentage            = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] rpc_response_timeout           = 120 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] run_external_periodic_tasks    = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] scst_target_driver             = iscsi {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] scst_target_iqn_name           = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] service_down_time              = 720 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] shell_completion               = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] snapshot_name_template         = snapshot-%s {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] split_loggers                  = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] state_path                     = /opt/stack/data/cinder {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] storage_availability_zone      = nova {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] storage_protocol               = iSCSI {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] syslog_log_facility            = LOG_USER {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] target_helper                  = lioadm {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] target_ip_address              = 192.168.122.126 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] target_port                    = 3260 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] target_protocol                = iscsi {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] target_secondary_ip_addresses  = [] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] trace_flags                    = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] transport_url                  = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] until_refresh                  = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] use_chap_auth                  = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] use_default_quota_class        = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] use_journal                    = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] use_json                       = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] use_multipath_for_image_xfer   = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] use_stderr                     = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] use_syslog                     = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] verify_glance_signatures       = enabled {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] volume_api_class               = cinder.volume.api.API {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] volume_backend_name            = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] volume_clear                   = zero {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] volume_clear_ionice            = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] volume_clear_size              = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] volume_copy_bps_limit          = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] volume_dd_blocksize            = 1M {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] volume_name_template           = volume-%s {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] volume_service_inithost_offload = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] volume_usage_audit_period      = month {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] zoning_mode                    = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_concurrency.disable_process_locking = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.auth_section = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.auth_type   = password {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.auth_version = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.cache       = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.certfile    = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.include_service_catalog = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.insecure    = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.interface   = public {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.keyfile     = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.memcache_password = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.memcache_username = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.region_name = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.service_type = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.126/identity {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.backend                  = dogpile.cache.null {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.backend_argument         = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.backend_expiration_time  = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.config_prefix            = cache.oslo {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 04 15:48:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.remotefs [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86926) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.debug_cache_backend      = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.enable_retry_client      = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.enable_socket_keepalive  = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.enabled                  = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.expiration_time          = 600 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.hashclient_retry_attempts = 2 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.memcache_dead_retry      = 300 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.memcache_sasl_enabled    = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.password                 = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.proxies                  = [] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.redis_db                 = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.redis_server             = localhost:6379 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.retry_attempts           = 2 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.retry_delay              = 0.0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.socket_keepalive_count   = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.socket_keepalive_idle    = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.socket_keepalive_interval = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.socket_timeout           = 1.0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.tls_allowed_ciphers      = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.tls_cafile               = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.tls_certfile             = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.tls_enabled              = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.tls_keyfile              = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cache.username                 = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] coordination.backend_url       = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] database.asyncio_connection    = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] database.asyncio_slave_connection = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] database.backend               = sqlalchemy {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] database.connection            = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] database.connection_debug      = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] database.connection_parameters =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] database.connection_recycle_time = 3600 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] database.connection_trace      = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] database.db_inc_retry_interval = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] database.db_max_retries        = 20 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] database.db_max_retry_interval = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] database.db_retry_interval     = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] database.max_overflow          = 50 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] database.max_pool_size         = 5 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] database.max_retries           = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] database.mysql_wsrep_sync_wait = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] database.pool_timeout          = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] database.retry_interval        = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] database.slave_connection      = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] database.sqlite_synchronous    = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] database.synchronous_reader    = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] database.use_db_reconnect      = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_tracing.insecure = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] profiler.connection_string     = messaging:// {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] profiler.enabled               = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] profiler.es_doc_type           = notification {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] profiler.es_scroll_size        = 10000 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] profiler.es_scroll_time        = 2m {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] profiler.filter_error_trace    = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] profiler.hmac_keys             = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] profiler.sentinel_service_name = mymaster {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] profiler.socket_timeout        = 0.1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] profiler.trace_requests        = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] profiler.trace_sqlalchemy      = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] profiler_jaeger.process_tags   = {} {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] profiler_jaeger.service_name_prefix = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] profiler_otlp.service_name_prefix = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_policy.enforce_new_defaults = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_policy.policy_default_rule = default {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] privsep_osbrick.group          = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] privsep_osbrick.helper_command = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] privsep_osbrick.user           = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cinder_sys_admin.group         = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cinder_sys_admin.helper_command = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] cinder_sys_admin.user          = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] service_user.auth_section      = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] service_user.auth_type         = password {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] service_user.cafile            = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] service_user.certfile          = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] service_user.collect_timing    = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] service_user.insecure          = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] service_user.keyfile           = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] service_user.send_service_user_token = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] service_user.split_loggers     = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] service_user.timeout           = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] service_user.tls_ciphers       = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] service_user.tls_min_version   = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] glance.auth_section            = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] glance.auth_type               = password {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] glance.certfile                = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] glance.collect_timing          = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] glance.insecure                = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] glance.keyfile                 = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] glance.region_name             = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] glance.split_loggers           = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] glance.timeout                 = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] glance.tls_ciphers             = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] glance.tls_min_version         = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.backend_availability_zone = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.chap_password = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.chap_username =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.disk_geometry = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.driver_client_cert = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.driver_client_cert_key = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.driver_data_namespace = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.driver_use_ssl = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.extra_capabilities = {} {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.filter_function = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.goodness_function = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.iscsi_target_flags =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.iscsi_write_cache = on {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.iser_ip_address = 192.168.122.126 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.iser_port     = 3260 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.nas_host      =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.nas_login     = admin {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.nas_mount_options = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.nas_password  = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.nas_private_key =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.nas_share_path =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.num_shell_tries = 3 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.quobyte_volume_url = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.replication_device = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.report_discard_supported = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.reserved_percentage = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.target_helper = tgtadm {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.target_ip_address = 192.168.122.126 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.target_port   = 3260 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.target_protocol = iscsi {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.trace_flags   = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.unique_fqdn_network = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.use_chap_auth = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.volume_backend_name = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.volume_clear  = zero {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.volume_clear_ionice = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.volume_clear_size = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_reports.file_event_handler = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_reports.log_dir           = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.backend_availability_zone = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.backend_host         = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.chap_password        = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.chap_username        = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.disk_geometry        = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.driver_client_cert   = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.driver_data_namespace = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.extra_capabilities   = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.filter_function      = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.goodness_function    = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.iser_helper          = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.iser_ip_address      = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.iser_port            = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.nas_host             = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.nas_login            = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.nas_mount_options    = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.nas_password         = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.nas_private_key      = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.nas_share_path       = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.num_shell_tries      = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.replication_device   = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.report_discard_supported = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.reserved_percentage  = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.scst_target_driver   = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.storage_protocol     = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.target_helper        = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.target_ip_address    = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.target_port          = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.target_prefix        = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.target_protocol      = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.trace_flags          = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.use_chap_auth        = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.volume_clear         = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.volume_clear_size    = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] QuobyteHD.volumes_dir          = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86926) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.quobyte [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86926]: WARNING cinder.volume.drivers.quobyte [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Running cmd (subprocess): mount.quobyte {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_notifications.driver = [] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_notifications.retry = -1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] key_manager.fixed_key          = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican.barbican_api_version  = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican.barbican_endpoint     = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican.barbican_endpoint_type = public {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican.barbican_region_name  = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican.cafile                = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican.certfile              = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican.collect_timing        = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican.insecure              = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican.keyfile               = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican.number_of_retries     = 60 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican.retry_delay           = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican.send_service_user_token = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican.split_loggers         = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican.timeout               = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican.tls_ciphers           = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican.tls_min_version       = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican.verify_ssl            = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican.verify_ssl_path       = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican_service_user.auth_section = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican_service_user.auth_type = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican_service_user.cafile   = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican_service_user.certfile = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican_service_user.collect_timing = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican_service_user.insecure = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican_service_user.keyfile  = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican_service_user.split_loggers = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican_service_user.timeout  = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican_service_user.tls_ciphers = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] barbican_service_user.tls_min_version = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] vault.approle_role_id          = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] vault.approle_secret_id        = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] vault.auth_method              = approle {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] vault.auth_path                = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] vault.kv_mountpoint            = secret {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] vault.kv_path                  = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] vault.kv_version               = 2 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] vault.namespace                = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] vault.root_token_id            = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] vault.ssl_ca_crt_file          = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] vault.timeout                  = 60.0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] vault.token_file               = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] vault.token_role               = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] vault.use_ssl                  = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:11 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] ******************************************************************************** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 04 15:48:11 devstack quobyte-client[86931]: Reading configuration file: /etc/quobyte/client.cfg
Sep 04 15:48:11 devstack quobyte-client[86931]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 04 15:48:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] CMD "mount.quobyte" returned: 1 in 0.085s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:48:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:48:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:48:11 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:48:11 devstack cinder-volume[86926]: INFO cinder.volume.drivers.quobyte [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 ...
Sep 04 15:48:11 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce -c /etc/quobyte/client-cinder.cfg {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:48:11 devstack sudo[86932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce -c /etc/quobyte/client-cinder.cfg
Sep 04 15:48:11 devstack sudo[86932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:48:12 devstack sudo[86932]: pam_unix(sudo:session): session closed for user root
Sep 04 15:48:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.406s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:48:12 devstack cinder-volume[86926]: INFO cinder.volume.drivers.quobyte [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 succeeded
Sep 04 15:48:12 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:48:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.421s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:48:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:48:12 devstack sudo[87001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:48:12 devstack sudo[87001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:48:12 devstack sudo[87001]: pam_unix(sudo:session): session closed for user root
Sep 04 15:48:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.252s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:48:12 devstack cinder-volume[86926]: INFO cinder.volume.driver [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Driver hasn't implemented _init_vendor_properties()
Sep 04 15:48:12 devstack cinder-volume[86926]: DEBUG cinder.volume.driver [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7594451904297, 'free_capacity_gb': 1773.7594451904297, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86926) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 04 15:48:12 devstack cinder-volume[86926]: DEBUG oslo_db.sqlalchemy.engines [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86926) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 15:48:12 devstack cinder-volume[86926]: DEBUG dbcounter [-] [86926] Writer thread running {{(pid=86926) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 04 15:48:12 devstack cinder-volume[86926]: DEBUG cinder.db.api [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Building query based on filter {{(pid=86926) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 04 15:48:12 devstack cinder-volume[86926]: DEBUG cinder.image.image_utils [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86926) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 04 15:48:12 devstack cinder-volume[86926]: INFO cinder.keymgr.migration [None req-cd072d2d-cc37-4ecf-b154-31f20b2028a4 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 04 15:48:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:48:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:48:12 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:48:12 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:48:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:48:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:48:12 devstack sudo[87004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:48:12 devstack sudo[87004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:48:12 devstack sudo[87004]: pam_unix(sudo:session): session closed for user root
Sep 04 15:48:12 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.236s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:48:12 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:48:12 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Driver initialization completed successfully.
Sep 04 15:48:12 devstack cinder-volume[86926]: INFO cinder.manager [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Initiating service 3 cleanup
Sep 04 15:48:12 devstack cinder-volume[86926]: INFO cinder.manager [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Service 3 cleanup completed.
Sep 04 15:48:12 devstack cinder-volume[86926]: DEBUG cinder.service [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Creating RPC server for service cinder-volume {{(pid=86926) start /opt/stack/cinder/cinder/service.py:231}}
Sep 04 15:48:12 devstack cinder-volume[86926]: DEBUG cinder.service [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86926) start /opt/stack/cinder/cinder/service.py:237}}
Sep 04 15:48:13 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 04 15:48:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:48:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:48:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:48:13 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:48:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:48:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:48:13 devstack sudo[87007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:48:13 devstack sudo[87007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:48:13 devstack sudo[87007]: pam_unix(sudo:session): session closed for user root
Sep 04 15:48:13 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.266s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:48:13 devstack cinder-volume[86926]: INFO cinder.volume.manager [None req-6c7d4071-6b13-40d2-8b73-e9c9a28f7bb1 None None] Driver post RPC initialization completed successfully.
Sep 04 15:48:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d0f0155d-6ae3-4d0a-8614-fe3a8ea5257b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:48:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d0f0155d-6ae3-4d0a-8614-fe3a8ea5257b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:48:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d0f0155d-6ae3-4d0a-8614-fe3a8ea5257b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=86926) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:48:17 devstack cinder-volume[86926]: DEBUG cinder.volume.drivers.quobyte [None req-d0f0155d-6ae3-4d0a-8614-fe3a8ea5257b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=86926) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:48:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-d0f0155d-6ae3-4d0a-8614-fe3a8ea5257b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86926) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:48:17 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d0f0155d-6ae3-4d0a-8614-fe3a8ea5257b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:48:17 devstack sudo[87160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:48:17 devstack sudo[87160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:48:18 devstack sudo[87160]: pam_unix(sudo:session): session closed for user root
Sep 04 15:48:18 devstack cinder-volume[86926]: DEBUG oslo_concurrency.processutils [None req-d0f0155d-6ae3-4d0a-8614-fe3a8ea5257b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.233s {{(pid=86926) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:48:18 devstack cinder-volume[86926]: DEBUG cinder.manager [None req-d0f0155d-6ae3-4d0a-8614-fe3a8ea5257b None None] Notifying Schedulers of capabilities ... {{(pid=86926) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:48:18 devstack cinder-volume[86710]: INFO oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Caught SIGTERM, stopping children
Sep 04 15:48:18 devstack cinder-volume[86710]: DEBUG oslo_concurrency.lockutils [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Acquiring lock "singleton_lock" {{(pid=86710) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 04 15:48:18 devstack cinder-volume[86710]: DEBUG oslo_concurrency.lockutils [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Acquired lock "singleton_lock" {{(pid=86710) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 04 15:48:18 devstack cinder-volume[86710]: DEBUG oslo_concurrency.lockutils [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Releasing lock "singleton_lock" {{(pid=86710) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 04 15:48:18 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Stop services. {{(pid=86710) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 04 15:48:18 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Killing children. {{(pid=86710) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 04 15:48:18 devstack cinder-volume[86710]: INFO oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Waiting on 1 children to exit
Sep 04 15:48:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Acquiring lock "singleton_lock" {{(pid=86926) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 04 15:48:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Acquired lock "singleton_lock" {{(pid=86926) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 04 15:48:21 devstack cinder-volume[86926]: DEBUG oslo_concurrency.lockutils [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Releasing lock "singleton_lock" {{(pid=86926) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 04 15:48:21 devstack cinder-volume[86926]: WARNING amqp [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 04 15:48:21 devstack cinder-volume[86926]: WARNING amqp [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 04 15:48:21 devstack cinder-volume[86710]: INFO oslo_service.backend._eventlet.service [None req-4bcf34da-951b-4743-a153-4e7916941602 None None] Child 86926 exited with status 0
Sep 04 15:48:21 devstack cinder-volume[87213]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 04 15:48:21 devstack cinder-volume[87213]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 04 15:48:21 devstack cinder-volume[87213]: we strongly recommend against using it for new projects.
Sep 04 15:48:21 devstack cinder-volume[87213]: If you are already using Eventlet, we recommend migrating to a different
Sep 04 15:48:21 devstack cinder-volume[87213]: framework.  For more detail see
Sep 04 15:48:21 devstack cinder-volume[87213]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 04 15:48:21 devstack cinder-volume[87213]:   import eventlet  # noqa
Sep 04 15:48:24 devstack cinder-volume[87213]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 04 15:48:24 devstack cinder-volume[87213]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 04 15:48:24 devstack cinder-volume[87213]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 04 15:48:25 devstack cinder-volume[87213]: INFO dbcounter [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] Registered counter for database cinder
Sep 04 15:48:25 devstack cinder-volume[87213]: DEBUG oslo_db.sqlalchemy.engines [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87213) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG dbcounter [-] [87213] Writer thread running {{(pid=87213) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 04 15:48:26 devstack cinder-volume[87213]: INFO cinder.rpc [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 04 15:48:26 devstack cinder-volume[87213]: INFO cinder.rpc [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_db.sqlalchemy.engines [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87213) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 15:48:26 devstack cinder-volume[87213]: INFO cinder.volume.manager [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] Determined volume DB was empty at startup.
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG cinder.volume.manager [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87213) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 04 15:48:26 devstack cinder-volume[87213]: WARNING stevedore.named [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 04 15:48:26 devstack cinder-volume[87213]: WARNING castellan.key_manager [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 04 15:48:26 devstack cinder-volume[87213]: WARNING cinder.keymgr.conf_key_mgr [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 04 15:48:26 devstack cinder-volume[87213]: INFO cinder.volume.manager [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_db.sqlalchemy.engines [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87213) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 15:48:26 devstack cinder-volume[87213]: INFO oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] Starting 1 workers
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] Started child 87504 {{(pid=87213) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 04 15:48:26 devstack cinder-volume[87504]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] Full set of CONF: {{(pid=87213) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] ******************************************************************************** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] Configuration options gathered from: {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] ================================================================================ {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] allow_availability_zone_fallback = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] allow_compression_on_image_upload = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] allowed_direct_url_schemes     = [] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] api_rate_limit                 = True {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] auth_strategy                  = keystone {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_availability_zone      = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_host                   = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_name                   = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_stats_polling_interval = 60 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backup_api_class               = cinder.backup.api.API {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backup_name_template           = backup-%s {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backup_use_same_host           = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backup_use_temp_snapshot       = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] chap_password                  = **** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] chap_username                  =  {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cinder_internal_tenant_project_id = c7bf635b1e244a53bd583343ef19d36d {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cinder_internal_tenant_user_id = 04d520aeca1f462e82a1001b21299fe8 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cluster                        = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] compression_format             = gzip {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] compute_api_class              = cinder.compute.nova.API {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] config_dir                     = [] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] config_source                  = [] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] control_exchange               = openstack {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] debug                          = True {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] default_availability_zone      = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] default_group_type             = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] default_volume_type            = QuobyteHD {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] disk_geometry                  = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] driver_client_cert             = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] driver_client_cert_key         = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] driver_data_namespace          = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] driver_ssl_cert_path           = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] driver_ssl_cert_verify         = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] driver_use_ssl                 = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] enable_new_services            = True {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] enable_unsupported_driver      = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] enabled_backends               = ['QuobyteHD'] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] enforce_multipath_for_image_xfer = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] filter_function                = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] glance_api_insecure            = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] glance_api_servers             = ['http://192.168.122.126/image'] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] glance_api_ssl_compression     = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] glance_ca_certificates_file    = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] glance_catalog_info            = image:glance:publicURL {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] glance_certfile                = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] glance_keyfile                 = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] glance_num_retries             = 3 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] glance_request_timeout         = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] goodness_function              = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] graceful_shutdown_timeout      = 5 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] group_api_class                = cinder.group.api.API {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] host                           = devstack {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] image_compress_on_upload       = True {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] image_conversion_address_space_limit = 1 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] image_conversion_cpu_limit     = 60 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] image_conversion_disable       = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] image_upload_use_cinder_backend = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] image_upload_use_internal_tenant = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 04 15:48:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-b68c678f-3105-4334-b46e-631657a23599 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87504) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] image_volume_cache_enabled     = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] image_volume_cache_max_count   = 0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] image_volume_cache_max_size_gb = 0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] init_host_max_objects_retrieval = 0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] instance_format                = [instance: %(uuid)s]  {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] iscsi_target_flags             =  {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] iscsi_write_cache              = on {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] iser_helper                    = tgtadm {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] iser_ip_address                = 192.168.122.126 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] iser_port                      = 3260 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] log_color                      = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] log_config_append              = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] log_dir                        = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] log_file                       = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] log_options                    = True {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] log_rotate_interval            = 1 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] log_rotate_interval_type       = days {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] log_rotation_type              = none {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] max_age                        = 0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] max_logfile_count              = 30 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] max_logfile_size_mb            = 200 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] max_over_subscription_ratio    = 20.0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] message_reap_interval          = 86400 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] message_ttl                    = 2592000 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] migration_create_volume_timeout_secs = 300 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] monkey_patch                   = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] monkey_patch_modules           = [] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] my_ip                          = 192.168.122.126 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] no_snapshot_gb_quota           = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] num_iser_scan_tries            = 3 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] num_shell_tries                = 3 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] num_volume_device_scan_tries   = 3 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] nvmeof_conn_info_version       = 1 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] nvmet_ns_id                    = 10 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] nvmet_port_id                  = 1 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] osapi_max_limit                = 1000 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] osapi_volume_ext_list          = [] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] osapi_volume_listen_port       = 8776 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] osapi_volume_use_ssl           = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] osapi_volume_workers           = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] per_volume_size_limit          = -1 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] periodic_fuzzy_delay           = 60 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] periodic_interval              = 60 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] public_endpoint                = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] publish_errors                 = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] quota_backup_gigabytes         = 1000 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] quota_backups                  = 10 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] quota_gigabytes                = 1000 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] quota_groups                   = 10 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] quota_snapshots                = 10 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] quota_volumes                  = 10 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] rate_limit_burst               = 0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] rate_limit_except_level        = CRITICAL {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] rate_limit_interval            = 0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] reinit_driver_count            = 3 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] replication_device             = **** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] report_discard_supported       = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] report_interval                = 120 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] reservation_clean_interval     = 86400 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] reservation_expire             = 86400 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] reserved_image_namespaces      = [] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] reserved_percentage            = 0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] rpc_response_timeout           = 120 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] run_external_periodic_tasks    = True {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] scst_target_driver             = iscsi {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] scst_target_iqn_name           = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] service_down_time              = 720 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] shell_completion               = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] snapshot_name_template         = snapshot-%s {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] split_loggers                  = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] state_path                     = /opt/stack/data/cinder {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] storage_availability_zone      = nova {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] storage_protocol               = iSCSI {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] syslog_log_facility            = LOG_USER {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] target_helper                  = lioadm {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] target_ip_address              = 192.168.122.126 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] target_port                    = 3260 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] target_protocol                = iscsi {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] target_secondary_ip_addresses  = [] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] trace_flags                    = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] transport_url                  = **** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] until_refresh                  = 0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] use_chap_auth                  = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] use_default_quota_class        = True {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] use_journal                    = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] use_json                       = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] use_multipath_for_image_xfer   = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] use_stderr                     = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] use_syslog                     = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] verify_glance_signatures       = enabled {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] volume_api_class               = cinder.volume.api.API {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] volume_backend_name            = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] volume_clear                   = zero {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] volume_clear_ionice            = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] volume_clear_size              = 0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] volume_copy_bps_limit          = 0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] volume_dd_blocksize            = 1M {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] volume_name_template           = volume-%s {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] volume_service_inithost_offload = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] volume_usage_audit_period      = month {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] zoning_mode                    = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_concurrency.disable_process_locking = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.auth_section = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.auth_type   = password {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.auth_version = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.cache       = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.certfile    = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.include_service_catalog = True {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.insecure    = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.interface   = public {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.keyfile     = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.memcache_password = **** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b68c678f-3105-4334-b46e-631657a23599 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87504) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 04 15:48:26 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.quobyte [None req-b68c678f-3105-4334-b46e-631657a23599 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 04 15:48:26 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.quobyte [None req-b68c678f-3105-4334-b46e-631657a23599 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 04 15:48:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Running cmd (subprocess): mount.quobyte {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.memcache_username = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.region_name = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.service_type = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.126/identity {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.backend                  = dogpile.cache.null {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.backend_argument         = **** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.backend_expiration_time  = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.config_prefix            = cache.oslo {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.debug_cache_backend      = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.enable_retry_client      = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.enable_socket_keepalive  = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.enabled                  = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.expiration_time          = 600 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.hashclient_retry_attempts = 2 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.memcache_dead_retry      = 300 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.memcache_pool_maxsize    = 10 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.memcache_sasl_enabled    = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.password                 = **** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.proxies                  = [] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.redis_db                 = 0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.redis_server             = localhost:6379 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.retry_attempts           = 2 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.retry_delay              = 0.0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.socket_keepalive_count   = 1 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.socket_keepalive_idle    = 1 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.socket_keepalive_interval = 1 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.socket_timeout           = 1.0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.tls_allowed_ciphers      = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.tls_cafile               = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.tls_certfile             = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.tls_enabled              = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.tls_keyfile              = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cache.username                 = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] coordination.backend_url       = **** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] database.asyncio_connection    = **** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] database.asyncio_slave_connection = **** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] database.backend               = sqlalchemy {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] database.connection            = **** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] database.connection_debug      = 0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] database.connection_parameters =  {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] database.connection_recycle_time = 3600 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] database.connection_trace      = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] database.db_inc_retry_interval = True {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] database.db_max_retries        = 20 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] database.db_max_retry_interval = 10 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] database.db_retry_interval     = 1 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] database.max_overflow          = 50 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] database.max_pool_size         = 5 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] database.max_retries           = 10 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] database.mysql_wsrep_sync_wait = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] database.pool_timeout          = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] database.retry_interval        = 10 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] database.slave_connection      = **** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] database.sqlite_synchronous    = True {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] database.synchronous_reader    = True {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] database.use_db_reconnect      = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_tracing.insecure = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] profiler.connection_string     = messaging:// {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] profiler.enabled               = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] profiler.es_doc_type           = notification {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] profiler.es_scroll_size        = 10000 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] profiler.es_scroll_time        = 2m {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] profiler.filter_error_trace    = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] profiler.hmac_keys             = **** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] profiler.sentinel_service_name = mymaster {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] profiler.socket_timeout        = 0.1 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] profiler.trace_requests        = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] profiler.trace_sqlalchemy      = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] profiler_jaeger.process_tags   = {} {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] profiler_jaeger.service_name_prefix = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] profiler_otlp.service_name_prefix = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_policy.enforce_new_defaults = True {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_policy.policy_default_rule = default {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_policy.policy_file        = policy.yaml {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] privsep_osbrick.group          = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] privsep_osbrick.helper_command = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] privsep_osbrick.user           = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cinder_sys_admin.group         = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cinder_sys_admin.helper_command = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] cinder_sys_admin.user          = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] service_user.auth_section      = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] service_user.auth_type         = password {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] service_user.cafile            = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] service_user.certfile          = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] service_user.collect_timing    = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] service_user.insecure          = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] service_user.keyfile           = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] service_user.send_service_user_token = True {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] service_user.split_loggers     = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] service_user.timeout           = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] service_user.tls_ciphers       = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] service_user.tls_min_version   = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] glance.auth_section            = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] glance.auth_type               = password {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] glance.certfile                = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack quobyte-client[87505]: Reading configuration file: /etc/quobyte/client.cfg
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] glance.collect_timing          = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] glance.insecure                = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] glance.keyfile                 = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] glance.region_name             = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] glance.split_loggers           = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] glance.timeout                 = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] glance.tls_ciphers             = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack quobyte-client[87505]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] glance.tls_min_version         = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.backend_availability_zone = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.chap_password = **** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.chap_username =  {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b68c678f-3105-4334-b46e-631657a23599 None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.disk_geometry = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.driver_client_cert = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.driver_client_cert_key = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.driver_data_namespace = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.driver_use_ssl = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.extra_capabilities = {} {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.filter_function = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.goodness_function = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.iscsi_target_flags =  {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.iscsi_write_cache = on {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.iser_helper   = tgtadm {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.iser_ip_address = 192.168.122.126 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.iser_port     = 3260 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.nas_host      =  {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.nas_login     = admin {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.nas_mount_options = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.nas_password  = **** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.nas_private_key =  {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.nas_share_path =  {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.num_shell_tries = 3 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.quobyte_volume_url = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.replication_device = **** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.report_discard_supported = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.reserved_percentage = 0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.target_helper = tgtadm {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.target_ip_address = 192.168.122.126 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.target_port   = 3260 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.target_protocol = iscsi {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.trace_flags   = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.unique_fqdn_network = True {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.use_chap_auth = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.volume_backend_name = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.volume_clear  = zero {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.volume_clear_ionice = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.volume_clear_size = 0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_reports.file_event_handler = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_reports.log_dir           = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.backend_availability_zone = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.backend_host         = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.chap_password        = **** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.chap_username        = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.chiscsi_conf         = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.disk_geometry        = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.driver_client_cert   = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.driver_data_namespace = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.driver_use_ssl       = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.extra_capabilities   = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.filter_function      = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.goodness_function    = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack sudo[87506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.iser_helper          = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.iser_ip_address      = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.iser_port            = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.iser_target_prefix   = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.nas_host             = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.nas_login            = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.nas_mount_options    = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.nas_password         = **** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.nas_private_key      = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.nas_share_path       = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.nas_ssh_port         = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.num_shell_tries      = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.nvmet_port_id        = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.replication_device   = **** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.report_discard_supported = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.reserved_percentage  = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.scst_target_driver   = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.storage_protocol     = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.target_helper        = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.target_ip_address    = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.target_port          = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.target_prefix        = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.target_protocol      = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.trace_flags          = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.use_chap_auth        = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.volume_clear         = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.volume_clear_size    = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] QuobyteHD.volumes_dir          = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.ssl      = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_notifications.driver = [] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_notifications.retry = -1 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] key_manager.fixed_key          = **** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican.barbican_api_version  = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican.barbican_endpoint     = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican.barbican_endpoint_type = public {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican.barbican_region_name  = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican.cafile                = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican.certfile              = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican.collect_timing        = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican.insecure              = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican.keyfile               = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican.number_of_retries     = 60 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican.retry_delay           = 1 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican.send_service_user_token = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican.split_loggers         = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican.timeout               = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican.tls_ciphers           = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican.tls_min_version       = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican.verify_ssl            = True {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican.verify_ssl_path       = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican_service_user.auth_section = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican_service_user.auth_type = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican_service_user.cafile   = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican_service_user.certfile = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican_service_user.collect_timing = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican_service_user.insecure = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican_service_user.keyfile  = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican_service_user.split_loggers = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican_service_user.timeout  = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican_service_user.tls_ciphers = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] barbican_service_user.tls_min_version = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] vault.approle_role_id          = **** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] vault.approle_secret_id        = **** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] vault.auth_method              = approle {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] vault.auth_path                = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] vault.kv_mountpoint            = secret {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] vault.kv_path                  = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] vault.kv_version               = 2 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] vault.namespace                = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] vault.root_token_id            = **** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] vault.ssl_ca_crt_file          = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] vault.timeout                  = 60.0 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] vault.token_file               = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] vault.token_role               = None {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] vault.use_ssl                  = False {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 15:48:26 devstack cinder-volume[87213]: DEBUG oslo_service.backend._eventlet.service [None req-9a96df5d-b420-401c-b0b0-5a6d243e06e0 None None] ******************************************************************************** {{(pid=87213) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 04 15:48:26 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root
Sep 04 15:48:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b68c678f-3105-4334-b46e-631657a23599 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.242s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:48:26 devstack cinder-volume[87504]: INFO cinder.volume.driver [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Driver hasn't implemented _init_vendor_properties()
Sep 04 15:48:26 devstack cinder-volume[87504]: DEBUG cinder.volume.driver [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7594451904297, 'free_capacity_gb': 1773.7594451904297, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87504) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 04 15:48:26 devstack cinder-volume[87504]: DEBUG oslo_db.sqlalchemy.engines [None req-b68c678f-3105-4334-b46e-631657a23599 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87504) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 15:48:26 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writer thread running {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 04 15:48:26 devstack cinder-volume[87504]: DEBUG cinder.db.api [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Building query based on filter {{(pid=87504) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 04 15:48:27 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87504) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 04 15:48:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:48:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:48:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:48:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:48:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:48:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:48:27 devstack cinder-volume[87504]: INFO cinder.keymgr.migration [None req-054d6735-94de-4805-98d1-94c42700d2bb None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 04 15:48:27 devstack sudo[87517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:48:27 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:48:27 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root
Sep 04 15:48:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b68c678f-3105-4334-b46e-631657a23599 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.230s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:48:27 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:48:27 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Driver initialization completed successfully.
Sep 04 15:48:27 devstack cinder-volume[87504]: INFO cinder.manager [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Initiating service 3 cleanup
Sep 04 15:48:27 devstack cinder-volume[87504]: INFO cinder.manager [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Service 3 cleanup completed.
Sep 04 15:48:27 devstack cinder-volume[87504]: DEBUG cinder.service [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Creating RPC server for service cinder-volume {{(pid=87504) start /opt/stack/cinder/cinder/service.py:231}}
Sep 04 15:48:27 devstack cinder-volume[87504]: DEBUG cinder.service [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87504) start /opt/stack/cinder/cinder/service.py:237}}
Sep 04 15:48:27 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 04 15:48:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:48:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:48:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:48:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:48:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:48:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:48:27 devstack sudo[87530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:48:27 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:48:27 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root
Sep 04 15:48:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b68c678f-3105-4334-b46e-631657a23599 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.252s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:48:27 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-b68c678f-3105-4334-b46e-631657a23599 None None] Driver post RPC initialization completed successfully.
Sep 04 15:48:36 devstack cinder-volume[87213]: DEBUG dbcounter [-] [87213] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87213) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:48:37 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=1 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:48:37 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:48:48 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager._thread_info {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:48:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread count: 6 {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 15:48:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread info: [<_MainThread(MainThread, started 131673838448768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131673724603200)>, <Thread(Thread-3 (stat_writer), started daemon 131673723495936)>, <Thread(Rabbit-heartbeat, started daemon 131673723764800)>, <Thread(Thread-5 (_runner), started daemon 131673722269632)>, <Thread(Thread-7 (_runner), started daemon 131673722322112)>] {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 15:49:26 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:49:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Flow 'volume_create_manager' (703bdea5-68cd-4cb5-80f4-12b21740b713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:49:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e0d6aa6-f34e-4ea2-9326-38db3b4be612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:49:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e0d6aa6-f34e-4ea2-9326-38db3b4be612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1036073513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032f4a1c-ced9-4080-9e62-58f7580c2aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfa9adb2309c4d17b2207191735025dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:49:26Z,use_quota=True,user_id='16bb5f2923da48929286f3b96126ce7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:49:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2400fcc9-0382-4c36-9d1d-a78af7e0c8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:49:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2400fcc9-0382-4c36-9d1d-a78af7e0c8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:49:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac89d7e-902d-4044-a4cb-28bb931240da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:49:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac89d7e-902d-4044-a4cb-28bb931240da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '032f4a1c-ced9-4080-9e62-58f7580c2aa9', 'volume_name': 'volume-032f4a1c-ced9-4080-9e62-58f7580c2aa9', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:49:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1892613-a132-4a2b-a70c-bb40ca2e8c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:49:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1892613-a132-4a2b-a70c-bb40ca2e8c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:49:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d860b3e2-b68b-4bde-980b-2a014c9abf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:49:26 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Volume 032f4a1c-ced9-4080-9e62-58f7580c2aa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-032f4a1c-ced9-4080-9e62-58f7580c2aa9', 'volume_size': 1}
Sep 04 15:49:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:49:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:49:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1036073513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032f4a1c-ced9-4080-9e62-58f7580c2aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfa9adb2309c4d17b2207191735025dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:49:26Z,use_quota=True,user_id='16bb5f2923da48929286f3b96126ce7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:49:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Creating volume 032f4a1c-ced9-4080-9e62-58f7580c2aa9 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:49:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:49:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:49:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:49:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:49:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:49:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:49:26 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:49:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-032f4a1c-ced9-4080-9e62-58f7580c2aa9 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:49:26 devstack sudo[88062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-032f4a1c-ced9-4080-9e62-58f7580c2aa9 1073741824
Sep 04 15:49:26 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:49:27 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root
Sep 04 15:49:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-032f4a1c-ced9-4080-9e62-58f7580c2aa9 1073741824" returned: 0 in 1.128s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:49:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-032f4a1c-ced9-4080-9e62-58f7580c2aa9 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:49:27 devstack sudo[88413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-032f4a1c-ced9-4080-9e62-58f7580c2aa9
Sep 04 15:49:27 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:49:28 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root
Sep 04 15:49:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-032f4a1c-ced9-4080-9e62-58f7580c2aa9" returned: 0 in 0.581s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:49:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:49:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:49:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d860b3e2-b68b-4bde-980b-2a014c9abf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-032f4a1c-ced9-4080-9e62-58f7580c2aa9', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:49:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d996e922-4fff-4d22-b55b-835921de1a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:49:28 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Volume volume-032f4a1c-ced9-4080-9e62-58f7580c2aa9 (032f4a1c-ced9-4080-9e62-58f7580c2aa9): created successfully
Sep 04 15:49:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d996e922-4fff-4d22-b55b-835921de1a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:49:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Flow 'volume_create_manager' (703bdea5-68cd-4cb5-80f4-12b21740b713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:49:28 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e11877fd-d7fe-4f1f-aa44-314691e4ed19 tempest-TaggedAttachmentsTest-958963400 None] Created volume successfully.
Sep 04 15:49:28 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:49:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Flow 'volume_create_manager' (8353d99c-bf2f-422e-906c-b5144fce420c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:49:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029bdb2d-db84-4ca9-84c3-5740f5751902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:49:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029bdb2d-db84-4ca9-84c3-5740f5751902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-907402718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afcd9904-1e7f-4865-a58c-f9d0a1a3e168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='738b74cf5b2544a3b4f4efa5ee024e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:49:29Z,use_quota=True,user_id='180fb729e2954d65a4fb6022408d9e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:49:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c52369a-66fe-4657-bb19-2a15ab110712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:49:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c52369a-66fe-4657-bb19-2a15ab110712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:49:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (144eb970-0656-4325-96e1-0e02458ca47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:49:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (144eb970-0656-4325-96e1-0e02458ca47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afcd9904-1e7f-4865-a58c-f9d0a1a3e168', 'volume_name': 'volume-afcd9904-1e7f-4865-a58c-f9d0a1a3e168', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:49:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1377d9-37e9-4b6f-99d4-90c55830747f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:49:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1377d9-37e9-4b6f-99d4-90c55830747f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:49:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c908e232-97d5-40c6-a22e-d5615dea4b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:49:29 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Volume afcd9904-1e7f-4865-a58c-f9d0a1a3e168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afcd9904-1e7f-4865-a58c-f9d0a1a3e168', 'volume_size': 1}
Sep 04 15:49:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:49:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:49:29 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-907402718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afcd9904-1e7f-4865-a58c-f9d0a1a3e168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='738b74cf5b2544a3b4f4efa5ee024e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:49:29Z,use_quota=True,user_id='180fb729e2954d65a4fb6022408d9e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:49:29 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Creating volume afcd9904-1e7f-4865-a58c-f9d0a1a3e168 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:49:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:49:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:49:29 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:49:29 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:49:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:49:29 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:49:29 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:49:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-afcd9904-1e7f-4865-a58c-f9d0a1a3e168 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:49:29 devstack sudo[88438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-afcd9904-1e7f-4865-a58c-f9d0a1a3e168 1073741824
Sep 04 15:49:29 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:49:29 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root
Sep 04 15:49:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-afcd9904-1e7f-4865-a58c-f9d0a1a3e168 1073741824" returned: 0 in 0.711s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:49:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-afcd9904-1e7f-4865-a58c-f9d0a1a3e168 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:49:29 devstack sudo[88445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-afcd9904-1e7f-4865-a58c-f9d0a1a3e168
Sep 04 15:49:29 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:49:30 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root
Sep 04 15:49:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-afcd9904-1e7f-4865-a58c-f9d0a1a3e168" returned: 0 in 0.364s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:49:30 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:49:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:49:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c908e232-97d5-40c6-a22e-d5615dea4b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afcd9904-1e7f-4865-a58c-f9d0a1a3e168', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:49:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cca3a57-7b9b-4c55-a563-6a060bbfcff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:49:30 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Volume volume-afcd9904-1e7f-4865-a58c-f9d0a1a3e168 (afcd9904-1e7f-4865-a58c-f9d0a1a3e168): created successfully
Sep 04 15:49:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cca3a57-7b9b-4c55-a563-6a060bbfcff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:49:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Flow 'volume_create_manager' (8353d99c-bf2f-422e-906c-b5144fce420c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:49:30 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-30f2f02c-b16c-4d54-a290-56d19cf0a904 tempest-DeleteServersTestJSON-2138282029 None] Created volume successfully.
Sep 04 15:49:37 devstack cinder-volume[87504]: WARNING py.warnings [req-e5333862-50bf-4790-ad79-6d9222a22ed3 req-2906ad61-c02e-40a5-bdc4-84c9de6f357e tempest-DeleteServersTestJSON-2138282029 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Sep 04 15:49:37 devstack cinder-volume[87504]:   .first()
Sep 04 15:49:37 devstack cinder-volume[87504]: 
Sep 04 15:49:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-e5333862-50bf-4790-ad79-6d9222a22ed3 req-2906ad61-c02e-40a5-bdc4-84c9de6f357e tempest-DeleteServersTestJSON-2138282029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:49:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-e5333862-50bf-4790-ad79-6d9222a22ed3 req-2906ad61-c02e-40a5-bdc4-84c9de6f357e tempest-DeleteServersTestJSON-2138282029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:49:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-e5333862-50bf-4790-ad79-6d9222a22ed3 req-2906ad61-c02e-40a5-bdc4-84c9de6f357e tempest-DeleteServersTestJSON-2138282029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:49:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-e5333862-50bf-4790-ad79-6d9222a22ed3 req-2906ad61-c02e-40a5-bdc4-84c9de6f357e tempest-DeleteServersTestJSON-2138282029 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236', 'name': 'volume-afcd9904-1e7f-4865-a58c-f9d0a1a3e168', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86a4f47b-bc71-4dc9-99ec-1c5003d6b4b1', 'enforce_multipath': True} {{(pid=87504) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 15:49:37 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-e5333862-50bf-4790-ad79-6d9222a22ed3 req-2906ad61-c02e-40a5-bdc4-84c9de6f357e tempest-DeleteServersTestJSON-2138282029 None] attachment_update completed successfully.
Sep 04 15:49:43 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-79dfe303-5690-4057-8b54-5fa45980e79b req-9db73e65-17e5-4b0c-be36-3f33c8d5f7ed tempest-DeleteServersTestJSON-2138282029 None] Terminate volume connection completed successfully.
Sep 04 15:49:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-79dfe303-5690-4057-8b54-5fa45980e79b req-9db73e65-17e5-4b0c-be36-3f33c8d5f7ed tempest-DeleteServersTestJSON-2138282029 None] Deleting attachment 86a4f47b-bc71-4dc9-99ec-1c5003d6b4b1. {{(pid=87504) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 15:49:46 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-51b981d8-8e7e-4dd1-afde-78dfb3464be6 tempest-DeleteServersTestJSON-2138282029 None] Acquiring lock "cinder-afcd9904-1e7f-4865-a58c-f9d0a1a3e168-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:49:46 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-51b981d8-8e7e-4dd1-afde-78dfb3464be6 tempest-DeleteServersTestJSON-2138282029 None] Lock "cinder-afcd9904-1e7f-4865-a58c-f9d0a1a3e168-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:49:46 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-51b981d8-8e7e-4dd1-afde-78dfb3464be6 tempest-DeleteServersTestJSON-2138282029 None] Acquiring lock "cinder-quobyte-afcd9904-1e7f-4865-a58c-f9d0a1a3e168" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:49:46 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-51b981d8-8e7e-4dd1-afde-78dfb3464be6 tempest-DeleteServersTestJSON-2138282029 None] Lock "cinder-quobyte-afcd9904-1e7f-4865-a58c-f9d0a1a3e168" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:49:46 devstack cinder-volume[87504]: INFO oslo.privsep.daemon [None req-51b981d8-8e7e-4dd1-afde-78dfb3464be6 tempest-DeleteServersTestJSON-2138282029 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpy5otvtjp/privsep.sock']
Sep 04 15:49:46 devstack sudo[89066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpy5otvtjp/privsep.sock
Sep 04 15:49:46 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:49:47 devstack cinder-volume[87504]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 04 15:49:47 devstack cinder-volume[87504]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 04 15:49:47 devstack cinder-volume[87504]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 04 15:49:47 devstack cinder-volume[87504]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 04 15:49:47 devstack cinder-volume[87504]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 04 15:49:47 devstack cinder-volume[87504]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 04 15:49:47 devstack cinder-volume[87504]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 04 15:49:47 devstack cinder-volume[87504]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 04 15:49:47 devstack cinder-volume[87504]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 04 15:49:47 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root
Sep 04 15:49:47 devstack cinder-volume[87504]: INFO oslo.privsep.daemon [None req-51b981d8-8e7e-4dd1-afde-78dfb3464be6 tempest-DeleteServersTestJSON-2138282029 None] Spawned new privsep daemon via rootwrap
Sep 04 15:49:47 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [None req-51b981d8-8e7e-4dd1-afde-78dfb3464be6 tempest-DeleteServersTestJSON-2138282029 None] Accepted privsep connection to /tmp/tmpy5otvtjp/privsep.sock {{(pid=87504) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 04 15:49:47 devstack cinder-volume[87504]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 04 15:49:47 devstack cinder-volume[87504]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 04 15:49:47 devstack cinder-volume[87504]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 04 15:49:47 devstack cinder-volume[87504]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89071
Sep 04 15:49:47 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f080a1-dace-4df3-8158-90fe9bf1e151]: (2,) {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:49:47 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd76613d-de66-42b5-9e93-ebb1c44c29f7]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:49:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-51b981d8-8e7e-4dd1-afde-78dfb3464be6 tempest-DeleteServersTestJSON-2138282029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-afcd9904-1e7f-4865-a58c-f9d0a1a3e168 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:49:47 devstack sudo[89073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-afcd9904-1e7f-4865-a58c-f9d0a1a3e168
Sep 04 15:49:47 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:49:48 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root
Sep 04 15:49:48 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:49:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:49:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:49:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:49:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:49:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:49:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:49:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-51b981d8-8e7e-4dd1-afde-78dfb3464be6 tempest-DeleteServersTestJSON-2138282029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-afcd9904-1e7f-4865-a58c-f9d0a1a3e168" returned: 0 in 0.878s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:49:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-51b981d8-8e7e-4dd1-afde-78dfb3464be6 tempest-DeleteServersTestJSON-2138282029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-afcd9904-1e7f-4865-a58c-f9d0a1a3e168 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:49:48 devstack sudo[89108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:49:48 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:49:48 devstack sudo[89109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-afcd9904-1e7f-4865-a58c-f9d0a1a3e168
Sep 04 15:49:48 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:49:49 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root
Sep 04 15:49:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-51b981d8-8e7e-4dd1-afde-78dfb3464be6 tempest-DeleteServersTestJSON-2138282029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-afcd9904-1e7f-4865-a58c-f9d0a1a3e168" returned: 0 in 0.495s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:49:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-51b981d8-8e7e-4dd1-afde-78dfb3464be6 tempest-DeleteServersTestJSON-2138282029 None] Lock "cinder-quobyte-afcd9904-1e7f-4865-a58c-f9d0a1a3e168" released by "delete_volume" :: held 3.075s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:49:49 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root
Sep 04 15:49:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.631s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:49:49 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:49:49 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager._thread_info {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:49:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread count: 8 {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 15:49:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread info: [<_MainThread(MainThread, started 131673838448768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131673724603200)>, <Thread(Thread-3 (stat_writer), started daemon 131673723495936)>, <Thread(Rabbit-heartbeat, started daemon 131673723764800)>, <Thread(Thread-5 (_runner), started daemon 131673722269632)>, <Thread(Thread-7 (_runner), started daemon 131673722322112)>, <Thread(fd_logger, started daemon 131673722585024)>, <Thread(privsep_reader, started daemon 131673721593984)>] {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 15:49:49 devstack cinder-volume[87504]: WARNING cinder.quota [None req-51b981d8-8e7e-4dd1-afde-78dfb3464be6 tempest-DeleteServersTestJSON-2138282029 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 04 15:49:49 devstack cinder-volume[87504]: WARNING cinder.quota [None req-51b981d8-8e7e-4dd1-afde-78dfb3464be6 tempest-DeleteServersTestJSON-2138282029 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 04 15:49:49 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-51b981d8-8e7e-4dd1-afde-78dfb3464be6 tempest-DeleteServersTestJSON-2138282029 None] Created reservations ['08252129-20f4-4dd3-900f-f333553b9010', '95103a6c-7bf0-4b0f-906a-a14450ca1da9', 'f0107245-477a-4251-b8e1-718fcdda8f32', '01184a99-c4a4-46fe-b5c2-49f238740c52'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:49:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-51b981d8-8e7e-4dd1-afde-78dfb3464be6 tempest-DeleteServersTestJSON-2138282029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:49:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-51b981d8-8e7e-4dd1-afde-78dfb3464be6 tempest-DeleteServersTestJSON-2138282029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:49:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-51b981d8-8e7e-4dd1-afde-78dfb3464be6 tempest-DeleteServersTestJSON-2138282029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:49:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-51b981d8-8e7e-4dd1-afde-78dfb3464be6 tempest-DeleteServersTestJSON-2138282029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:49:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-51b981d8-8e7e-4dd1-afde-78dfb3464be6 tempest-DeleteServersTestJSON-2138282029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:49:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-51b981d8-8e7e-4dd1-afde-78dfb3464be6 tempest-DeleteServersTestJSON-2138282029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:49:49 devstack sudo[89154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:49:49 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:49:50 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root
Sep 04 15:49:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-51b981d8-8e7e-4dd1-afde-78dfb3464be6 tempest-DeleteServersTestJSON-2138282029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.369s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:49:50 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-51b981d8-8e7e-4dd1-afde-78dfb3464be6 tempest-DeleteServersTestJSON-2138282029 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:49:50 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-51b981d8-8e7e-4dd1-afde-78dfb3464be6 tempest-DeleteServersTestJSON-2138282029 None] Deleted volume successfully.
Sep 04 15:49:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-51b981d8-8e7e-4dd1-afde-78dfb3464be6 tempest-DeleteServersTestJSON-2138282029 None] Lock "cinder-afcd9904-1e7f-4865-a58c-f9d0a1a3e168-delete_volume" released by "delete_volume" :: held 3.986s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:49:59 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=17,cinder:INSERT=3,cinder:UPDATE=13,cinder:DELETE=2 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:50:00 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:UPDATE=18,cinder:SELECT=16,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:50:07 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:50:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Flow 'volume_create_manager' (4e8b6a8d-6e36-4ded-babb-0e72f4822caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:50:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767bbf2a-c9f3-4546-8e87-509196689a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:50:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767bbf2a-c9f3-4546-8e87-509196689a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1121337556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af91ef0-9bea-4ce9-9708-6a09805de990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b50aa5d47904ba4a5135761fb65bea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:07Z,use_quota=True,user_id='e327112852c04e0e9fb5df5e6fdaebfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:50:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ecd238-7f80-4634-90d9-7cc8ca959b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:50:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ecd238-7f80-4634-90d9-7cc8ca959b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:50:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085d4511-31b3-4e6e-b49f-06a9ee1a0824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:50:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085d4511-31b3-4e6e-b49f-06a9ee1a0824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8af91ef0-9bea-4ce9-9708-6a09805de990', 'volume_name': 'volume-8af91ef0-9bea-4ce9-9708-6a09805de990', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:50:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9407f13-6ee5-4482-8195-5e2d3d37e903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:50:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9407f13-6ee5-4482-8195-5e2d3d37e903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:50:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c209c422-0498-4d1e-9547-31443563e1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:50:07 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Volume 8af91ef0-9bea-4ce9-9708-6a09805de990: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8af91ef0-9bea-4ce9-9708-6a09805de990', 'volume_size': 1}
Sep 04 15:50:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:50:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:50:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1121337556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af91ef0-9bea-4ce9-9708-6a09805de990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b50aa5d47904ba4a5135761fb65bea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:07Z,use_quota=True,user_id='e327112852c04e0e9fb5df5e6fdaebfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:50:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Creating volume 8af91ef0-9bea-4ce9-9708-6a09805de990 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:50:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:50:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:50:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:50:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:50:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:50:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:50:07 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:50:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8af91ef0-9bea-4ce9-9708-6a09805de990 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:50:07 devstack sudo[89248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8af91ef0-9bea-4ce9-9708-6a09805de990 1073741824
Sep 04 15:50:07 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:50:07 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root
Sep 04 15:50:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8af91ef0-9bea-4ce9-9708-6a09805de990 1073741824" returned: 0 in 0.561s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:50:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8af91ef0-9bea-4ce9-9708-6a09805de990 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:50:07 devstack sudo[89254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8af91ef0-9bea-4ce9-9708-6a09805de990
Sep 04 15:50:07 devstack sudo[89254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:50:08 devstack sudo[89254]: pam_unix(sudo:session): session closed for user root
Sep 04 15:50:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8af91ef0-9bea-4ce9-9708-6a09805de990" returned: 0 in 0.275s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:50:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:50:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:50:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c209c422-0498-4d1e-9547-31443563e1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8af91ef0-9bea-4ce9-9708-6a09805de990', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:50:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10fad711-8435-4fcb-a4b7-cb5aceebfd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:50:08 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Volume volume-8af91ef0-9bea-4ce9-9708-6a09805de990 (8af91ef0-9bea-4ce9-9708-6a09805de990): created successfully
Sep 04 15:50:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10fad711-8435-4fcb-a4b7-cb5aceebfd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:50:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Flow 'volume_create_manager' (4e8b6a8d-6e36-4ded-babb-0e72f4822caa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:50:08 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-2e7c9944-2d69-43b8-94aa-51f2d2c87f5c tempest-ServerActionsTestOtherA-701184065 None] Created volume successfully.
Sep 04 15:50:18 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3,cinder:INSERT=1 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:50:18 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:50:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-2706da24-6f70-4248-a54d-be202e0747a7 req-e0c7a219-8a45-4422-bb9a-96fb476f7bb9 tempest-TaggedAttachmentsTest-958963400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:50:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-2706da24-6f70-4248-a54d-be202e0747a7 req-e0c7a219-8a45-4422-bb9a-96fb476f7bb9 tempest-TaggedAttachmentsTest-958963400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:50:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-2706da24-6f70-4248-a54d-be202e0747a7 req-e0c7a219-8a45-4422-bb9a-96fb476f7bb9 tempest-TaggedAttachmentsTest-958963400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:50:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-2706da24-6f70-4248-a54d-be202e0747a7 req-e0c7a219-8a45-4422-bb9a-96fb476f7bb9 tempest-TaggedAttachmentsTest-958963400 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236', 'name': 'volume-032f4a1c-ced9-4080-9e62-58f7580c2aa9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67d1f341-50e6-4a24-bcd1-8c0ae32082c3', 'enforce_multipath': True} {{(pid=87504) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 15:50:30 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-2706da24-6f70-4248-a54d-be202e0747a7 req-e0c7a219-8a45-4422-bb9a-96fb476f7bb9 tempest-TaggedAttachmentsTest-958963400 None] attachment_update completed successfully.
Sep 04 15:50:35 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-d1f3e82c-4970-462e-ba53-40fc64b8c736 req-7d0aaea0-70f8-4364-983c-a345bec0a814 tempest-TaggedAttachmentsTest-958963400 None] Terminate volume connection completed successfully.
Sep 04 15:50:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-d1f3e82c-4970-462e-ba53-40fc64b8c736 req-7d0aaea0-70f8-4364-983c-a345bec0a814 tempest-TaggedAttachmentsTest-958963400 None] Deleting attachment 67d1f341-50e6-4a24-bcd1-8c0ae32082c3. {{(pid=87504) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 15:50:40 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:50:45 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:UPDATE=3,cinder:SELECT=8 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:50:48 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:50:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:50:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:50:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:50:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:50:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:50:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:50:48 devstack sudo[90039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:50:48 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:50:49 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root
Sep 04 15:50:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.522s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:50:49 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:50:49 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager._thread_info {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:50:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread count: 8 {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 15:50:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread info: [<_MainThread(MainThread, started 131673838448768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131673724603200)>, <Thread(Thread-3 (stat_writer), started daemon 131673723495936)>, <Thread(Rabbit-heartbeat, started daemon 131673723764800)>, <Thread(Thread-5 (_runner), started daemon 131673722269632)>, <Thread(Thread-7 (_runner), started daemon 131673722322112)>, <Thread(fd_logger, started daemon 131673722585024)>, <Thread(privsep_reader, started daemon 131673721593984)>] {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 15:50:54 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:50:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Flow 'volume_create_manager' (b894c528-fe8a-4406-9508-24cc313938c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:50:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc66fd85-5dff-4c1e-9e7c-a45ef2c2e932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:50:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc66fd85-5dff-4c1e-9e7c-a45ef2c2e932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-889902922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466cd933-2b79-40b6-9562-d3fe383ff7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa4d27b50c924a6a9e8de2878ddaa310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:54Z,use_quota=True,user_id='b49f1334584e42028ca501b76d49333f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:50:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4842f6f-91ff-462c-b12c-c48935f1c714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:50:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4842f6f-91ff-462c-b12c-c48935f1c714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:50:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd62866-b52a-426b-982d-a615b3eeb384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:50:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd62866-b52a-426b-982d-a615b3eeb384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '466cd933-2b79-40b6-9562-d3fe383ff7a6', 'volume_name': 'volume-466cd933-2b79-40b6-9562-d3fe383ff7a6', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:50:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733a3e30-c76b-4d38-ada7-2ee4531ebd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:50:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733a3e30-c76b-4d38-ada7-2ee4531ebd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:50:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e75a69c1-99be-4517-bf2d-f91cb5948488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:50:54 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Volume 466cd933-2b79-40b6-9562-d3fe383ff7a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-466cd933-2b79-40b6-9562-d3fe383ff7a6', 'volume_size': 1}
Sep 04 15:50:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:50:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:50:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-889902922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466cd933-2b79-40b6-9562-d3fe383ff7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa4d27b50c924a6a9e8de2878ddaa310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:54Z,use_quota=True,user_id='b49f1334584e42028ca501b76d49333f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:50:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Creating volume 466cd933-2b79-40b6-9562-d3fe383ff7a6 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:50:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:50:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:50:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:50:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:50:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:50:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:50:54 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:50:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-466cd933-2b79-40b6-9562-d3fe383ff7a6 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:50:54 devstack sudo[90156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-466cd933-2b79-40b6-9562-d3fe383ff7a6 1073741824
Sep 04 15:50:54 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:50:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-37896e74-1791-4ff4-bfd4-33e82d49a37d tempest-TaggedAttachmentsTest-958963400 None] Acquiring lock "cinder-032f4a1c-ced9-4080-9e62-58f7580c2aa9-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:50:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-37896e74-1791-4ff4-bfd4-33e82d49a37d tempest-TaggedAttachmentsTest-958963400 None] Lock "cinder-032f4a1c-ced9-4080-9e62-58f7580c2aa9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:50:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-37896e74-1791-4ff4-bfd4-33e82d49a37d tempest-TaggedAttachmentsTest-958963400 None] Acquiring lock "cinder-quobyte-032f4a1c-ced9-4080-9e62-58f7580c2aa9" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:50:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-37896e74-1791-4ff4-bfd4-33e82d49a37d tempest-TaggedAttachmentsTest-958963400 None] Lock "cinder-quobyte-032f4a1c-ced9-4080-9e62-58f7580c2aa9" acquired by "delete_volume" :: waited 0.058s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:50:55 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b0b4e4-c27b-4d10-aff3-76d358784aac]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:50:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-37896e74-1791-4ff4-bfd4-33e82d49a37d tempest-TaggedAttachmentsTest-958963400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-032f4a1c-ced9-4080-9e62-58f7580c2aa9 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:50:55 devstack sudo[90162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-032f4a1c-ced9-4080-9e62-58f7580c2aa9
Sep 04 15:50:55 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:50:55 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root
Sep 04 15:50:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-466cd933-2b79-40b6-9562-d3fe383ff7a6 1073741824" returned: 0 in 0.808s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:50:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-466cd933-2b79-40b6-9562-d3fe383ff7a6 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:50:55 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root
Sep 04 15:50:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-37896e74-1791-4ff4-bfd4-33e82d49a37d tempest-TaggedAttachmentsTest-958963400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-032f4a1c-ced9-4080-9e62-58f7580c2aa9" returned: 0 in 0.440s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:50:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-37896e74-1791-4ff4-bfd4-33e82d49a37d tempest-TaggedAttachmentsTest-958963400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-032f4a1c-ced9-4080-9e62-58f7580c2aa9 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:50:55 devstack sudo[90167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-466cd933-2b79-40b6-9562-d3fe383ff7a6
Sep 04 15:50:55 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:50:55 devstack sudo[90168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-032f4a1c-ced9-4080-9e62-58f7580c2aa9
Sep 04 15:50:55 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:50:55 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root
Sep 04 15:50:55 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root
Sep 04 15:50:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-37896e74-1791-4ff4-bfd4-33e82d49a37d tempest-TaggedAttachmentsTest-958963400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-032f4a1c-ced9-4080-9e62-58f7580c2aa9" returned: 0 in 0.296s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:50:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-466cd933-2b79-40b6-9562-d3fe383ff7a6" returned: 0 in 0.313s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:50:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:50:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:50:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-37896e74-1791-4ff4-bfd4-33e82d49a37d tempest-TaggedAttachmentsTest-958963400 None] Lock "cinder-quobyte-032f4a1c-ced9-4080-9e62-58f7580c2aa9" released by "delete_volume" :: held 0.808s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:50:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e75a69c1-99be-4517-bf2d-f91cb5948488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-466cd933-2b79-40b6-9562-d3fe383ff7a6', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:50:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d5eb0cc-d3d3-4fbf-8b18-d16d0e230615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:50:55 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Volume volume-466cd933-2b79-40b6-9562-d3fe383ff7a6 (466cd933-2b79-40b6-9562-d3fe383ff7a6): created successfully
Sep 04 15:50:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d5eb0cc-d3d3-4fbf-8b18-d16d0e230615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:50:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Flow 'volume_create_manager' (b894c528-fe8a-4406-9508-24cc313938c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:50:55 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-a697277e-e3eb-4869-9fce-d989649d6480 tempest-VolumesAdminNegativeTest-1105298526 None] Created volume successfully.
Sep 04 15:50:56 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-37896e74-1791-4ff4-bfd4-33e82d49a37d tempest-TaggedAttachmentsTest-958963400 None] Created reservations ['3bfdace7-bd75-466f-bf58-77a41aa06b5c', 'be4ccaea-1bae-4039-80b5-6fabc57ad541', 'a3c06d8c-ea78-4c2f-96c4-76274099f1ad', 'a9c5dce9-f019-4f7f-b27d-23d0b5e407fa'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:50:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-37896e74-1791-4ff4-bfd4-33e82d49a37d tempest-TaggedAttachmentsTest-958963400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:50:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-37896e74-1791-4ff4-bfd4-33e82d49a37d tempest-TaggedAttachmentsTest-958963400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:50:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-37896e74-1791-4ff4-bfd4-33e82d49a37d tempest-TaggedAttachmentsTest-958963400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:50:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-37896e74-1791-4ff4-bfd4-33e82d49a37d tempest-TaggedAttachmentsTest-958963400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:50:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-37896e74-1791-4ff4-bfd4-33e82d49a37d tempest-TaggedAttachmentsTest-958963400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:50:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-37896e74-1791-4ff4-bfd4-33e82d49a37d tempest-TaggedAttachmentsTest-958963400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:50:56 devstack sudo[90174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:50:56 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:50:56 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root
Sep 04 15:50:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-37896e74-1791-4ff4-bfd4-33e82d49a37d tempest-TaggedAttachmentsTest-958963400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.292s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:50:56 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-37896e74-1791-4ff4-bfd4-33e82d49a37d tempest-TaggedAttachmentsTest-958963400 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:50:56 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-37896e74-1791-4ff4-bfd4-33e82d49a37d tempest-TaggedAttachmentsTest-958963400 None] Deleted volume successfully.
Sep 04 15:50:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-37896e74-1791-4ff4-bfd4-33e82d49a37d tempest-TaggedAttachmentsTest-958963400 None] Lock "cinder-032f4a1c-ced9-4080-9e62-58f7580c2aa9-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:50:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f91240cc-f5b7-41e2-af7a-f56b0b206b91 tempest-VolumesAdminNegativeTest-1105298526 None] Acquiring lock "cinder-466cd933-2b79-40b6-9562-d3fe383ff7a6-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:50:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f91240cc-f5b7-41e2-af7a-f56b0b206b91 tempest-VolumesAdminNegativeTest-1105298526 None] Lock "cinder-466cd933-2b79-40b6-9562-d3fe383ff7a6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:50:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f91240cc-f5b7-41e2-af7a-f56b0b206b91 tempest-VolumesAdminNegativeTest-1105298526 None] Acquiring lock "cinder-quobyte-466cd933-2b79-40b6-9562-d3fe383ff7a6" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:50:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f91240cc-f5b7-41e2-af7a-f56b0b206b91 tempest-VolumesAdminNegativeTest-1105298526 None] Lock "cinder-quobyte-466cd933-2b79-40b6-9562-d3fe383ff7a6" acquired by "delete_volume" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:50:56 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a499086c-27ec-46e4-84e8-81bd6e5c6838]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:50:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f91240cc-f5b7-41e2-af7a-f56b0b206b91 tempest-VolumesAdminNegativeTest-1105298526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-466cd933-2b79-40b6-9562-d3fe383ff7a6 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:50:56 devstack sudo[90206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-466cd933-2b79-40b6-9562-d3fe383ff7a6
Sep 04 15:50:56 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:50:57 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root
Sep 04 15:50:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f91240cc-f5b7-41e2-af7a-f56b0b206b91 tempest-VolumesAdminNegativeTest-1105298526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-466cd933-2b79-40b6-9562-d3fe383ff7a6" returned: 0 in 0.386s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:50:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f91240cc-f5b7-41e2-af7a-f56b0b206b91 tempest-VolumesAdminNegativeTest-1105298526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-466cd933-2b79-40b6-9562-d3fe383ff7a6 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:50:57 devstack sudo[90211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-466cd933-2b79-40b6-9562-d3fe383ff7a6
Sep 04 15:50:57 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:50:57 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root
Sep 04 15:50:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f91240cc-f5b7-41e2-af7a-f56b0b206b91 tempest-VolumesAdminNegativeTest-1105298526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-466cd933-2b79-40b6-9562-d3fe383ff7a6" returned: 0 in 0.264s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:50:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f91240cc-f5b7-41e2-af7a-f56b0b206b91 tempest-VolumesAdminNegativeTest-1105298526 None] Lock "cinder-quobyte-466cd933-2b79-40b6-9562-d3fe383ff7a6" released by "delete_volume" :: held 0.694s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:50:57 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-f91240cc-f5b7-41e2-af7a-f56b0b206b91 tempest-VolumesAdminNegativeTest-1105298526 None] Created reservations ['0ebf147f-51c3-4354-b074-09c613d7e26b', '453196e0-3a70-4c48-b5b9-44de223b2d0d', '97fadb98-ef1c-46e1-a5ec-6d503cf9131f', '31c4e885-2357-4802-a2ea-e0dbe57907c1'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:50:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f91240cc-f5b7-41e2-af7a-f56b0b206b91 tempest-VolumesAdminNegativeTest-1105298526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:50:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f91240cc-f5b7-41e2-af7a-f56b0b206b91 tempest-VolumesAdminNegativeTest-1105298526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:50:57 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f91240cc-f5b7-41e2-af7a-f56b0b206b91 tempest-VolumesAdminNegativeTest-1105298526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:50:57 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f91240cc-f5b7-41e2-af7a-f56b0b206b91 tempest-VolumesAdminNegativeTest-1105298526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:50:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f91240cc-f5b7-41e2-af7a-f56b0b206b91 tempest-VolumesAdminNegativeTest-1105298526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:50:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f91240cc-f5b7-41e2-af7a-f56b0b206b91 tempest-VolumesAdminNegativeTest-1105298526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:50:57 devstack sudo[90214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:50:57 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:50:57 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root
Sep 04 15:50:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f91240cc-f5b7-41e2-af7a-f56b0b206b91 tempest-VolumesAdminNegativeTest-1105298526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.285s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:50:57 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-f91240cc-f5b7-41e2-af7a-f56b0b206b91 tempest-VolumesAdminNegativeTest-1105298526 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:50:57 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f91240cc-f5b7-41e2-af7a-f56b0b206b91 tempest-VolumesAdminNegativeTest-1105298526 None] Deleted volume successfully.
Sep 04 15:50:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f91240cc-f5b7-41e2-af7a-f56b0b206b91 tempest-VolumesAdminNegativeTest-1105298526 None] Lock "cinder-466cd933-2b79-40b6-9562-d3fe383ff7a6-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:51:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-7060050f-6ef7-45e4-b243-a4a994aad087 req-5916302a-cc87-4d47-b629-defbd8d5163e tempest-ServerActionsTestOtherA-701184065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:51:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-7060050f-6ef7-45e4-b243-a4a994aad087 req-5916302a-cc87-4d47-b629-defbd8d5163e tempest-ServerActionsTestOtherA-701184065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:51:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-7060050f-6ef7-45e4-b243-a4a994aad087 req-5916302a-cc87-4d47-b629-defbd8d5163e tempest-ServerActionsTestOtherA-701184065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:51:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-7060050f-6ef7-45e4-b243-a4a994aad087 req-5916302a-cc87-4d47-b629-defbd8d5163e tempest-ServerActionsTestOtherA-701184065 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236', 'name': 'volume-8af91ef0-9bea-4ce9-9708-6a09805de990', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb7bede6-ed1e-4c8e-ae22-dc5f8df856d9', 'enforce_multipath': True} {{(pid=87504) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 15:51:00 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-7060050f-6ef7-45e4-b243-a4a994aad087 req-5916302a-cc87-4d47-b629-defbd8d5163e tempest-ServerActionsTestOtherA-701184065 None] attachment_update completed successfully.
Sep 04 15:51:07 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-77882bdb-f219-489d-a444-257182fda3bb req-6909ae9e-fd4e-4387-86df-c823294e13a9 tempest-ServerActionsTestOtherA-701184065 None] Terminate volume connection completed successfully.
Sep 04 15:51:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-77882bdb-f219-489d-a444-257182fda3bb req-6909ae9e-fd4e-4387-86df-c823294e13a9 tempest-ServerActionsTestOtherA-701184065 None] Deleting attachment eb7bede6-ed1e-4c8e-ae22-dc5f8df856d9. {{(pid=87504) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 15:51:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-77882bdb-f219-489d-a444-257182fda3bb req-03ee7d68-f06d-43c8-82c8-e729eb4ebbd7 tempest-ServerActionsTestOtherA-701184065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:51:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-77882bdb-f219-489d-a444-257182fda3bb req-03ee7d68-f06d-43c8-82c8-e729eb4ebbd7 tempest-ServerActionsTestOtherA-701184065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:51:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-77882bdb-f219-489d-a444-257182fda3bb req-03ee7d68-f06d-43c8-82c8-e729eb4ebbd7 tempest-ServerActionsTestOtherA-701184065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:51:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-77882bdb-f219-489d-a444-257182fda3bb req-03ee7d68-f06d-43c8-82c8-e729eb4ebbd7 tempest-ServerActionsTestOtherA-701184065 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236', 'name': 'volume-8af91ef0-9bea-4ce9-9708-6a09805de990', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6dfeba7a-bf71-4a9f-99eb-01e133f64eb4', 'enforce_multipath': True} {{(pid=87504) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 15:51:08 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-77882bdb-f219-489d-a444-257182fda3bb req-03ee7d68-f06d-43c8-82c8-e729eb4ebbd7 tempest-ServerActionsTestOtherA-701184065 None] attachment_update completed successfully.
Sep 04 15:51:09 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:51:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Flow 'volume_create_manager' (30e40d05-9f6e-4fec-9c2b-6399ac6ad3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:51:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95dbd77c-ed8a-429a-80fb-c71f620c2ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:51:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95dbd77c-ed8a-429a-80fb-c71f620c2ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-428701598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287dabe0-5454-4935-a765-595f48247316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8ec8be6bdcd44018ee64ab2d221cea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:09Z,use_quota=True,user_id='0a719ac04af049d296325c285edc2c0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:51:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da95c2cb-6e02-4533-838b-8759d81d815a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:51:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da95c2cb-6e02-4533-838b-8759d81d815a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:51:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64917742-aead-4eb1-8a75-51d738438226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:51:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64917742-aead-4eb1-8a75-51d738438226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '287dabe0-5454-4935-a765-595f48247316', 'volume_name': 'volume-287dabe0-5454-4935-a765-595f48247316', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:51:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0aaf1c6-8a39-4666-96e2-0e15ea73ae82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:51:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0aaf1c6-8a39-4666-96e2-0e15ea73ae82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:51:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe3a1e0-7010-4842-ab8e-ff679368af66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:51:09 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Volume 287dabe0-5454-4935-a765-595f48247316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-287dabe0-5454-4935-a765-595f48247316', 'volume_size': 1}
Sep 04 15:51:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:51:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:51:09 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-428701598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287dabe0-5454-4935-a765-595f48247316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8ec8be6bdcd44018ee64ab2d221cea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:09Z,use_quota=True,user_id='0a719ac04af049d296325c285edc2c0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:51:09 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Creating volume 287dabe0-5454-4935-a765-595f48247316 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:51:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:51:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:51:09 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:51:09 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:51:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:51:09 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:51:09 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:51:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-287dabe0-5454-4935-a765-595f48247316 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:51:09 devstack sudo[90781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-287dabe0-5454-4935-a765-595f48247316 1073741824
Sep 04 15:51:09 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:51:10 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root
Sep 04 15:51:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-287dabe0-5454-4935-a765-595f48247316 1073741824" returned: 0 in 0.905s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:51:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-287dabe0-5454-4935-a765-595f48247316 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:51:10 devstack sudo[91154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-287dabe0-5454-4935-a765-595f48247316
Sep 04 15:51:10 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:51:10 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root
Sep 04 15:51:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-287dabe0-5454-4935-a765-595f48247316" returned: 0 in 0.455s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:51:10 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:51:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:51:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe3a1e0-7010-4842-ab8e-ff679368af66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-287dabe0-5454-4935-a765-595f48247316', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:51:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094a0896-b7fc-419c-87c1-72047bf9d921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:51:10 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Volume volume-287dabe0-5454-4935-a765-595f48247316 (287dabe0-5454-4935-a765-595f48247316): created successfully
Sep 04 15:51:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094a0896-b7fc-419c-87c1-72047bf9d921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:51:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Flow 'volume_create_manager' (30e40d05-9f6e-4fec-9c2b-6399ac6ad3d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:51:11 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-9232e2b4-f4a1-4fbb-b190-3fe728932e02 tempest-AttachVolumeShelveTestJSON-499348625 None] Created volume successfully.
Sep 04 15:51:21 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=33,cinder:INSERT=4,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:51:21 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:UPDATE=26,cinder:SELECT=23,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:51:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-4895bc4c-5b5f-4006-ac96-89ae242eb11c req-9824b53b-0f9b-439e-899b-e949377b6c30 tempest-AttachVolumeShelveTestJSON-499348625 None] No connector for attachment 53eca95e-55c0-4d3e-ac77-1dbe4280d5ac; skipping storage backend terminate_connection call. {{(pid=87504) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 04 15:51:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-4895bc4c-5b5f-4006-ac96-89ae242eb11c req-9824b53b-0f9b-439e-899b-e949377b6c30 tempest-AttachVolumeShelveTestJSON-499348625 None] Deleting attachment 53eca95e-55c0-4d3e-ac77-1dbe4280d5ac. {{(pid=87504) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 15:51:37 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=1 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:51:37 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=1 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:51:39 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-c43989bc-3e05-4767-a148-3f1be8ca0e87 req-1a2bc576-4582-4fcc-af34-fdeb4b343b2d tempest-ServerActionsTestOtherA-701184065 None] Terminate volume connection completed successfully.
Sep 04 15:51:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-c43989bc-3e05-4767-a148-3f1be8ca0e87 req-1a2bc576-4582-4fcc-af34-fdeb4b343b2d tempest-ServerActionsTestOtherA-701184065 None] Deleting attachment 6dfeba7a-bf71-4a9f-99eb-01e133f64eb4. {{(pid=87504) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 15:51:48 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:51:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:51:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:51:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:51:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:51:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:51:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:51:48 devstack sudo[91589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:51:48 devstack sudo[91589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:51:49 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=1 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:51:49 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=1 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:51:49 devstack sudo[91589]: pam_unix(sudo:session): session closed for user root
Sep 04 15:51:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.794s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:51:49 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:51:56 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:51:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Flow 'volume_create_manager' (3f5f763c-36dc-47b8-8b13-5ec68e2bf2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:51:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd42df9-d37d-4f7b-94d5-8337d5a99c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:51:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd42df9-d37d-4f7b-94d5-8337d5a99c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1766481671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e724e03d-0fe6-4989-ba1b-7790d4d68e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b50aa5d47904ba4a5135761fb65bea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:57Z,use_quota=True,user_id='e327112852c04e0e9fb5df5e6fdaebfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:51:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98458772-51dc-4c23-9ebf-68c118c433a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:51:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98458772-51dc-4c23-9ebf-68c118c433a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:51:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9024d385-253f-4e22-ab3b-6fca77fe3256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:51:56 devstack cinder-volume[87504]: DEBUG cinder.image.glance [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Creating Keystone auth plugin from conf {{(pid=87504) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 04 15:51:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9024d385-253f-4e22-ab3b-6fca77fe3256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e724e03d-0fe6-4989-ba1b-7790d4d68e27', 'volume_name': 'volume-e724e03d-0fe6-4989-ba1b-7790d4d68e27', 'volume_size': 1, 'image_id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f6dbd3908a2d48468b7f486df9705903', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9488c80e-bb64-48e5-b1fb-9998fd167822/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1ad3b7410>}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:51:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3798a03a-2902-4317-85cf-bed2395961c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:51:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3798a03a-2902-4317-85cf-bed2395961c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:51:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5d0c11-2879-4813-b2d6-4640a958b163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:51:58 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Volume e724e03d-0fe6-4989-ba1b-7790d4d68e27: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e724e03d-0fe6-4989-ba1b-7790d4d68e27', 'volume_size': 1, 'image_id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f6dbd3908a2d48468b7f486df9705903', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9488c80e-bb64-48e5-b1fb-9998fd167822/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1ad3b7410>}
Sep 04 15:51:58 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Trying to clone e724e03d-0fe6-4989-ba1b-7790d4d68e27 from image 9488c80e-bb64-48e5-b1fb-9998fd167822 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}]). {{(pid=87504) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 04 15:51:59 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_4yxw3_v9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 04 15:51:59 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Image download 20.69 MB at 20.61 MB/s
Sep 04 15:51:59 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ce9a1f-42de-438b-ad38-60a2d367bfec]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:51:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_4yxw3_v9devstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:00 devstack sudo[91704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_4yxw3_v9devstack@QuobyteHD
Sep 04 15:52:00 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:01 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_4yxw3_v9devstack@QuobyteHD" returned: 0 in 1.556s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:01 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Temporary image 9488c80e-bb64-48e5-b1fb-9998fd167822 is fetched for user e327112852c04e0e9fb5df5e6fdaebfb. {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 04 15:52:01 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbacdaa-ea7e-4ece-9039-b3f5f2d46232]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:52:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_4yxw3_v9devstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:01 devstack sudo[91781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_4yxw3_v9devstack@QuobyteHD
Sep 04 15:52:01 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:02 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_4yxw3_v9devstack@QuobyteHD" returned: 0 in 1.050s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:52:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:52:02 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1766481671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e724e03d-0fe6-4989-ba1b-7790d4d68e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b50aa5d47904ba4a5135761fb65bea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:57Z,use_quota=True,user_id='e327112852c04e0e9fb5df5e6fdaebfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:52:02 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Creating volume e724e03d-0fe6-4989-ba1b-7790d4d68e27 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:52:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:52:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:52:02 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:52:02 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:52:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.058s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:52:02 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:52:02 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:52:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e724e03d-0fe6-4989-ba1b-7790d4d68e27 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:02 devstack sudo[91793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e724e03d-0fe6-4989-ba1b-7790d4d68e27 1073741824
Sep 04 15:52:02 devstack sudo[91793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:04 devstack sudo[91793]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e724e03d-0fe6-4989-ba1b-7790d4d68e27 1073741824" returned: 0 in 1.491s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e724e03d-0fe6-4989-ba1b-7790d4d68e27 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:04 devstack sudo[91804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e724e03d-0fe6-4989-ba1b-7790d4d68e27
Sep 04 15:52:04 devstack sudo[91804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:05 devstack sudo[91804]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e724e03d-0fe6-4989-ba1b-7790d4d68e27" returned: 0 in 0.842s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] <== create_volume: return (2480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:52:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.498s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:52:05 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Attempting download of 9488c80e-bb64-48e5-b1fb-9998fd167822 ((None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}])) to volume e724e03d-0fe6-4989-ba1b-7790d4d68e27. {{(pid=87504) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 04 15:52:05 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec96e23f-be4d-4c5d-b317-7121e36177e1]: (4, 'raw') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:52:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_utw9t_j5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:05 devstack sudo[91807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_utw9t_j5
Sep 04 15:52:05 devstack sudo[91807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:05 devstack sudo[91807]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_utw9t_j5" returned: 0 in 0.488s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_utw9t_j5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:05 devstack sudo[91811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_utw9t_j5
Sep 04 15:52:05 devstack sudo[91811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:06 devstack sudo[91811]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_utw9t_j5" returned: 1 in 0.655s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_utw9t_j5' failed. Not Retrying. {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 15:52:06 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b5d17a-b5c3-439d-9031-450d43744b2f]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:52:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_4yxw3_v9devstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:06 devstack sudo[91815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_4yxw3_v9devstack@QuobyteHD
Sep 04 15:52:06 devstack sudo[91815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:07 devstack sudo[91815]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_4yxw3_v9devstack@QuobyteHD" returned: 0 in 0.940s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:07 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] 9488c80e-bb64-48e5-b1fb-9998fd167822 was qcow2, converting to qcow2 {{(pid=87504) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 04 15:52:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_4yxw3_v9devstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e724e03d-0fe6-4989-ba1b-7790d4d68e27 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:07 devstack sudo[91823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_4yxw3_v9devstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e724e03d-0fe6-4989-ba1b-7790d4d68e27
Sep 04 15:52:07 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:08 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:52:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Flow 'volume_create_manager' (dfec84b5-2d6c-443d-b375-3444339f65ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:52:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (718658dc-4bdb-4297-a981-7f63d7d30410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:52:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (718658dc-4bdb-4297-a981-7f63d7d30410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2142543398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a8aef6c-3603-455e-b49b-fdcb6aea41ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10a9ee79dd634ff6b5e21015c3e4c0aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:08Z,use_quota=True,user_id='54ba06f32edc4d178ce3bc5dedc7f9fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d86245e1-e73b-4d07-bc95-e4f8c987bd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:52:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d86245e1-e73b-4d07-bc95-e4f8c987bd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e37d6308-51e3-494a-8a52-f7a95215737e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:52:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e37d6308-51e3-494a-8a52-f7a95215737e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a8aef6c-3603-455e-b49b-fdcb6aea41ee', 'volume_name': 'volume-0a8aef6c-3603-455e-b49b-fdcb6aea41ee', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ade51f-d550-471a-9672-f838f9946c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:52:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ade51f-d550-471a-9672-f838f9946c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554cd29f-ddba-453b-bb4e-4f93e3053709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:52:08 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Volume 0a8aef6c-3603-455e-b49b-fdcb6aea41ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a8aef6c-3603-455e-b49b-fdcb6aea41ee', 'volume_size': 1}
Sep 04 15:52:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:52:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:52:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2142543398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a8aef6c-3603-455e-b49b-fdcb6aea41ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10a9ee79dd634ff6b5e21015c3e4c0aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:08Z,use_quota=True,user_id='54ba06f32edc4d178ce3bc5dedc7f9fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:52:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Creating volume 0a8aef6c-3603-455e-b49b-fdcb6aea41ee {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:52:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:52:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:52:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:52:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:52:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:52:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:52:08 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:52:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0a8aef6c-3603-455e-b49b-fdcb6aea41ee 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:08 devstack sudo[91839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0a8aef6c-3603-455e-b49b-fdcb6aea41ee 1073741824
Sep 04 15:52:08 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:09 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0a8aef6c-3603-455e-b49b-fdcb6aea41ee 1073741824" returned: 0 in 0.942s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0a8aef6c-3603-455e-b49b-fdcb6aea41ee {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:09 devstack sudo[91857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0a8aef6c-3603-455e-b49b-fdcb6aea41ee
Sep 04 15:52:09 devstack sudo[91857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:10 devstack sudo[91857]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0a8aef6c-3603-455e-b49b-fdcb6aea41ee" returned: 0 in 0.475s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:10 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:52:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:52:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554cd29f-ddba-453b-bb4e-4f93e3053709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a8aef6c-3603-455e-b49b-fdcb6aea41ee', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff454de-80fe-4276-a93a-17e48513b45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:52:10 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Volume volume-0a8aef6c-3603-455e-b49b-fdcb6aea41ee (0a8aef6c-3603-455e-b49b-fdcb6aea41ee): created successfully
Sep 04 15:52:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff454de-80fe-4276-a93a-17e48513b45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Flow 'volume_create_manager' (dfec84b5-2d6c-443d-b375-3444339f65ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:52:10 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-3eb3076b-20c7-4716-a876-d963a9e81137 tempest-ServerRescueNegativeTestJSON-2049252693 None] Created volume successfully.
Sep 04 15:52:11 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_4yxw3_v9devstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e724e03d-0fe6-4989-ba1b-7790d4d68e27" returned: 0 in 3.676s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:11 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_4yxw3_v9devstack@QuobyteHD, size 112.00 MB, duration 3.68 sec, destination /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e724e03d-0fe6-4989-ba1b-7790d4d68e27 {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 15:52:11 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Converted 112.00 MB image at 30.46 MB/s
Sep 04 15:52:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e724e03d-0fe6-4989-ba1b-7790d4d68e27 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:11 devstack sudo[91872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e724e03d-0fe6-4989-ba1b-7790d4d68e27 1G
Sep 04 15:52:11 devstack sudo[91872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:11 devstack sudo[91872]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e724e03d-0fe6-4989-ba1b-7790d4d68e27 1G" returned: 0 in 0.731s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:11 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Downloaded image 9488c80e-bb64-48e5-b1fb-9998fd167822 ((None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}])) to volume e724e03d-0fe6-4989-ba1b-7790d4d68e27 successfully. {{(pid=87504) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 04 15:52:11 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Temporary image 9488c80e-bb64-48e5-b1fb-9998fd167822 for user e327112852c04e0e9fb5df5e6fdaebfb is deleted. {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 04 15:52:11 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Marking volume e724e03d-0fe6-4989-ba1b-7790d4d68e27 as bootable. {{(pid=87504) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 04 15:52:11 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Copying metadata from image 9488c80e-bb64-48e5-b1fb-9998fd167822 to e724e03d-0fe6-4989-ba1b-7790d4d68e27. {{(pid=87504) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 04 15:52:11 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Creating volume glance metadata for volume e724e03d-0fe6-4989-ba1b-7790d4d68e27 backed by image 9488c80e-bb64-48e5-b1fb-9998fd167822 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87504) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 04 15:52:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5d0c11-2879-4813-b2d6-4640a958b163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e724e03d-0fe6-4989-ba1b-7790d4d68e27', 'volume_size': 1, 'image_id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f6dbd3908a2d48468b7f486df9705903', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9488c80e-bb64-48e5-b1fb-9998fd167822/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1ad3b7410>}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520d2682-c518-41b5-b409-4d05cb6f3eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:52:12 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Volume volume-e724e03d-0fe6-4989-ba1b-7790d4d68e27 (e724e03d-0fe6-4989-ba1b-7790d4d68e27): created successfully
Sep 04 15:52:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520d2682-c518-41b5-b409-4d05cb6f3eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Flow 'volume_create_manager' (3f5f763c-36dc-47b8-8b13-5ec68e2bf2eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:52:12 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-5eb92efd-567d-4c99-8c9f-7627ee79c678 tempest-ServerActionsTestOtherA-701184065 None] Created volume successfully.
Sep 04 15:52:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-de247dcb-9f85-4221-acfd-12c5409840d9 req-8dd2aaa3-b38d-4dbe-82ae-392cdf6344c7 tempest-ServerActionsTestOtherA-701184065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:52:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-de247dcb-9f85-4221-acfd-12c5409840d9 req-8dd2aaa3-b38d-4dbe-82ae-392cdf6344c7 tempest-ServerActionsTestOtherA-701184065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:52:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-de247dcb-9f85-4221-acfd-12c5409840d9 req-8dd2aaa3-b38d-4dbe-82ae-392cdf6344c7 tempest-ServerActionsTestOtherA-701184065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:52:20 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-de247dcb-9f85-4221-acfd-12c5409840d9 req-8dd2aaa3-b38d-4dbe-82ae-392cdf6344c7 tempest-ServerActionsTestOtherA-701184065 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236', 'name': 'volume-e724e03d-0fe6-4989-ba1b-7790d4d68e27', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec05f0d7-35a5-41f5-bfe3-652887242468', 'enforce_multipath': True} {{(pid=87504) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 15:52:20 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-de247dcb-9f85-4221-acfd-12c5409840d9 req-8dd2aaa3-b38d-4dbe-82ae-392cdf6344c7 tempest-ServerActionsTestOtherA-701184065 None] attachment_update completed successfully.
Sep 04 15:52:28 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:52:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Flow 'volume_create_manager' (570289db-cf1c-4e9e-b569-c5c6d8e29028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:52:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8b8a30-019e-49e4-bc88-7b07350d8186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:52:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8b8a30-019e-49e4-bc88-7b07350d8186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-115428359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd821b97-f1ed-463b-8e11-968dfb398534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='149a19dd713d4aeaaf3c93a0f76b57ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:28Z,use_quota=True,user_id='a38e79c602df4ffdb051ce925ea5fbd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d415d500-5015-4a6b-b152-d5b054cbb19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:52:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d415d500-5015-4a6b-b152-d5b054cbb19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ecb2bb7-8965-4a0c-9a88-23ed34ca2a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:52:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ecb2bb7-8965-4a0c-9a88-23ed34ca2a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd821b97-f1ed-463b-8e11-968dfb398534', 'volume_name': 'volume-dd821b97-f1ed-463b-8e11-968dfb398534', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20070dd2-f876-4a89-9a64-521dfa1080ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:52:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20070dd2-f876-4a89-9a64-521dfa1080ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365a5dc7-7001-4ef2-bc0e-aef087bfb4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:52:28 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Volume dd821b97-f1ed-463b-8e11-968dfb398534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd821b97-f1ed-463b-8e11-968dfb398534', 'volume_size': 1}
Sep 04 15:52:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:52:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:52:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-115428359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd821b97-f1ed-463b-8e11-968dfb398534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='149a19dd713d4aeaaf3c93a0f76b57ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:28Z,use_quota=True,user_id='a38e79c602df4ffdb051ce925ea5fbd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:52:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Creating volume dd821b97-f1ed-463b-8e11-968dfb398534 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:52:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:52:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:52:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:52:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:52:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:52:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:52:28 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:52:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dd821b97-f1ed-463b-8e11-968dfb398534 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:28 devstack sudo[92506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dd821b97-f1ed-463b-8e11-968dfb398534 1073741824
Sep 04 15:52:28 devstack sudo[92506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:30 devstack sudo[92506]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dd821b97-f1ed-463b-8e11-968dfb398534 1073741824" returned: 0 in 1.845s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dd821b97-f1ed-463b-8e11-968dfb398534 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:30 devstack sudo[92553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dd821b97-f1ed-463b-8e11-968dfb398534
Sep 04 15:52:30 devstack sudo[92553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:31 devstack sudo[92553]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dd821b97-f1ed-463b-8e11-968dfb398534" returned: 0 in 0.611s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] <== create_volume: return (2598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:52:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.607s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:52:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365a5dc7-7001-4ef2-bc0e-aef087bfb4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd821b97-f1ed-463b-8e11-968dfb398534', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a01c4a-fcf5-4389-b7a1-eab0e17a8245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:52:31 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e2acb483-af44-497d-ab3d-568c2ccd76bc tempest-ServerRescueNegativeTestJSON-2049252693 None] Acquiring lock "cinder-0a8aef6c-3603-455e-b49b-fdcb6aea41ee-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:52:31 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Volume volume-dd821b97-f1ed-463b-8e11-968dfb398534 (dd821b97-f1ed-463b-8e11-968dfb398534): created successfully
Sep 04 15:52:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a01c4a-fcf5-4389-b7a1-eab0e17a8245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Flow 'volume_create_manager' (570289db-cf1c-4e9e-b569-c5c6d8e29028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:52:31 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e2acb483-af44-497d-ab3d-568c2ccd76bc tempest-ServerRescueNegativeTestJSON-2049252693 None] Lock "cinder-0a8aef6c-3603-455e-b49b-fdcb6aea41ee-delete_volume" acquired by "delete_volume" :: waited 0.204s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:52:31 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-ef2eb518-5bf5-4efc-b2f0-6d836a07d143 tempest-ServersNegativeTestJSON-1061367339 None] Created volume successfully.
Sep 04 15:52:31 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e2acb483-af44-497d-ab3d-568c2ccd76bc tempest-ServerRescueNegativeTestJSON-2049252693 None] Acquiring lock "cinder-quobyte-0a8aef6c-3603-455e-b49b-fdcb6aea41ee" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:52:31 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e2acb483-af44-497d-ab3d-568c2ccd76bc tempest-ServerRescueNegativeTestJSON-2049252693 None] Lock "cinder-quobyte-0a8aef6c-3603-455e-b49b-fdcb6aea41ee" acquired by "delete_volume" :: waited 0.060s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:52:31 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[049164aa-3a20-4ae4-99f4-549204935017]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:52:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e2acb483-af44-497d-ab3d-568c2ccd76bc tempest-ServerRescueNegativeTestJSON-2049252693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0a8aef6c-3603-455e-b49b-fdcb6aea41ee {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:32 devstack sudo[92572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0a8aef6c-3603-455e-b49b-fdcb6aea41ee
Sep 04 15:52:32 devstack sudo[92572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:32 devstack sudo[92572]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e2acb483-af44-497d-ab3d-568c2ccd76bc tempest-ServerRescueNegativeTestJSON-2049252693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0a8aef6c-3603-455e-b49b-fdcb6aea41ee" returned: 0 in 1.061s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e2acb483-af44-497d-ab3d-568c2ccd76bc tempest-ServerRescueNegativeTestJSON-2049252693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0a8aef6c-3603-455e-b49b-fdcb6aea41ee {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:32 devstack sudo[92586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0a8aef6c-3603-455e-b49b-fdcb6aea41ee
Sep 04 15:52:32 devstack sudo[92586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:33 devstack sudo[92586]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e2acb483-af44-497d-ab3d-568c2ccd76bc tempest-ServerRescueNegativeTestJSON-2049252693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0a8aef6c-3603-455e-b49b-fdcb6aea41ee" returned: 0 in 0.583s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:33 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e2acb483-af44-497d-ab3d-568c2ccd76bc tempest-ServerRescueNegativeTestJSON-2049252693 None] Lock "cinder-quobyte-0a8aef6c-3603-455e-b49b-fdcb6aea41ee" released by "delete_volume" :: held 1.778s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:52:33 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-e2acb483-af44-497d-ab3d-568c2ccd76bc tempest-ServerRescueNegativeTestJSON-2049252693 None] Created reservations ['209c2567-afaf-4100-9a2e-1110843f6851', 'e1c6b7da-1c1d-4aa3-96f7-e25406b73631', '80552854-0363-4c08-be9a-31278e59ac96', '79f6f6f1-6b87-4800-8a7a-6a028801f110'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:52:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e2acb483-af44-497d-ab3d-568c2ccd76bc tempest-ServerRescueNegativeTestJSON-2049252693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:52:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e2acb483-af44-497d-ab3d-568c2ccd76bc tempest-ServerRescueNegativeTestJSON-2049252693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:52:33 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e2acb483-af44-497d-ab3d-568c2ccd76bc tempest-ServerRescueNegativeTestJSON-2049252693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:52:33 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e2acb483-af44-497d-ab3d-568c2ccd76bc tempest-ServerRescueNegativeTestJSON-2049252693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:52:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e2acb483-af44-497d-ab3d-568c2ccd76bc tempest-ServerRescueNegativeTestJSON-2049252693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:52:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e2acb483-af44-497d-ab3d-568c2ccd76bc tempest-ServerRescueNegativeTestJSON-2049252693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:33 devstack sudo[92592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:52:33 devstack sudo[92592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:34 devstack sudo[92592]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e2acb483-af44-497d-ab3d-568c2ccd76bc tempest-ServerRescueNegativeTestJSON-2049252693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.767s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:34 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-e2acb483-af44-497d-ab3d-568c2ccd76bc tempest-ServerRescueNegativeTestJSON-2049252693 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:52:34 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e2acb483-af44-497d-ab3d-568c2ccd76bc tempest-ServerRescueNegativeTestJSON-2049252693 None] Deleted volume successfully.
Sep 04 15:52:34 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e2acb483-af44-497d-ab3d-568c2ccd76bc tempest-ServerRescueNegativeTestJSON-2049252693 None] Lock "cinder-0a8aef6c-3603-455e-b49b-fdcb6aea41ee-delete_volume" released by "delete_volume" :: held 3.209s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:52:38 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:52:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Flow 'volume_create_manager' (2d4eda73-6348-4219-b70d-d390165cd526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:52:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57efab8-9709-4f92-89b8-8f29584212cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:52:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57efab8-9709-4f92-89b8-8f29584212cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1993493363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c58df9f-ecee-45eb-a648-37937c6d3043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='149a19dd713d4aeaaf3c93a0f76b57ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:38Z,use_quota=True,user_id='a38e79c602df4ffdb051ce925ea5fbd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01bdd413-c0ef-4608-b826-e79ce9dbe0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:52:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01bdd413-c0ef-4608-b826-e79ce9dbe0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9ca0e3-36cf-449a-a023-d63b7d90a3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:52:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9ca0e3-36cf-449a-a023-d63b7d90a3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c58df9f-ecee-45eb-a648-37937c6d3043', 'volume_name': 'volume-8c58df9f-ecee-45eb-a648-37937c6d3043', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed0b91d9-29e0-4954-89e6-ad43155c2480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:52:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed0b91d9-29e0-4954-89e6-ad43155c2480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4aa262f-061c-4c2b-8fb1-351debe2fd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:52:38 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Volume 8c58df9f-ecee-45eb-a648-37937c6d3043: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c58df9f-ecee-45eb-a648-37937c6d3043', 'volume_size': 1}
Sep 04 15:52:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:52:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:52:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1993493363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c58df9f-ecee-45eb-a648-37937c6d3043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='149a19dd713d4aeaaf3c93a0f76b57ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:38Z,use_quota=True,user_id='a38e79c602df4ffdb051ce925ea5fbd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:52:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Creating volume 8c58df9f-ecee-45eb-a648-37937c6d3043 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:52:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:52:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:52:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:52:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:52:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:52:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:52:38 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:52:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8c58df9f-ecee-45eb-a648-37937c6d3043 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:38 devstack sudo[92628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8c58df9f-ecee-45eb-a648-37937c6d3043 1073741824
Sep 04 15:52:38 devstack sudo[92628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:39 devstack sudo[92628]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8c58df9f-ecee-45eb-a648-37937c6d3043 1073741824" returned: 0 in 1.401s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8c58df9f-ecee-45eb-a648-37937c6d3043 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:39 devstack sudo[92638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8c58df9f-ecee-45eb-a648-37937c6d3043
Sep 04 15:52:39 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:40 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c8586f07-bd1f-4c91-ac02-5a0faa08de6e tempest-AttachVolumeShelveTestJSON-499348625 None] Acquiring lock "cinder-287dabe0-5454-4935-a765-595f48247316-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:52:40 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c8586f07-bd1f-4c91-ac02-5a0faa08de6e tempest-AttachVolumeShelveTestJSON-499348625 None] Lock "cinder-287dabe0-5454-4935-a765-595f48247316-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:52:40 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8c58df9f-ecee-45eb-a648-37937c6d3043" returned: 0 in 0.880s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:40 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] <== create_volume: return (2420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:52:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.426s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:52:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4aa262f-061c-4c2b-8fb1-351debe2fd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c58df9f-ecee-45eb-a648-37937c6d3043', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1923d5a7-5355-48f1-9391-9ec358560db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:52:40 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c8586f07-bd1f-4c91-ac02-5a0faa08de6e tempest-AttachVolumeShelveTestJSON-499348625 None] Acquiring lock "cinder-quobyte-287dabe0-5454-4935-a765-595f48247316" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:52:40 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c8586f07-bd1f-4c91-ac02-5a0faa08de6e tempest-AttachVolumeShelveTestJSON-499348625 None] Lock "cinder-quobyte-287dabe0-5454-4935-a765-595f48247316" acquired by "delete_volume" :: waited 0.050s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:52:40 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Volume volume-8c58df9f-ecee-45eb-a648-37937c6d3043 (8c58df9f-ecee-45eb-a648-37937c6d3043): created successfully
Sep 04 15:52:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1923d5a7-5355-48f1-9391-9ec358560db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Flow 'volume_create_manager' (2d4eda73-6348-4219-b70d-d390165cd526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:52:40 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fc1bb8-0d9a-4fd5-9777-81e7b5fa2c75]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:52:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c8586f07-bd1f-4c91-ac02-5a0faa08de6e tempest-AttachVolumeShelveTestJSON-499348625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-287dabe0-5454-4935-a765-595f48247316 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:40 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-3de4ed89-355a-435d-b97f-ac67c4d42e15 tempest-ServersNegativeTestJSON-1061367339 None] Created volume successfully.
Sep 04 15:52:41 devstack sudo[92645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-287dabe0-5454-4935-a765-595f48247316
Sep 04 15:52:41 devstack sudo[92645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:41 devstack sudo[92645]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c8586f07-bd1f-4c91-ac02-5a0faa08de6e tempest-AttachVolumeShelveTestJSON-499348625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-287dabe0-5454-4935-a765-595f48247316" returned: 0 in 0.832s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c8586f07-bd1f-4c91-ac02-5a0faa08de6e tempest-AttachVolumeShelveTestJSON-499348625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-287dabe0-5454-4935-a765-595f48247316 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:41 devstack sudo[92671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-287dabe0-5454-4935-a765-595f48247316
Sep 04 15:52:41 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:42 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c8586f07-bd1f-4c91-ac02-5a0faa08de6e tempest-AttachVolumeShelveTestJSON-499348625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-287dabe0-5454-4935-a765-595f48247316" returned: 0 in 0.598s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:42 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c8586f07-bd1f-4c91-ac02-5a0faa08de6e tempest-AttachVolumeShelveTestJSON-499348625 None] Lock "cinder-quobyte-287dabe0-5454-4935-a765-595f48247316" released by "delete_volume" :: held 1.539s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:52:42 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f31c993e-30a7-4fca-b4e6-af96577fb4e6 tempest-ServersNegativeTestJSON-1061367339 None] Acquiring lock "cinder-8c58df9f-ecee-45eb-a648-37937c6d3043-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:52:42 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f31c993e-30a7-4fca-b4e6-af96577fb4e6 tempest-ServersNegativeTestJSON-1061367339 None] Lock "cinder-8c58df9f-ecee-45eb-a648-37937c6d3043-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:52:42 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f31c993e-30a7-4fca-b4e6-af96577fb4e6 tempest-ServersNegativeTestJSON-1061367339 None] Acquiring lock "cinder-quobyte-8c58df9f-ecee-45eb-a648-37937c6d3043" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:52:42 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-c8586f07-bd1f-4c91-ac02-5a0faa08de6e tempest-AttachVolumeShelveTestJSON-499348625 None] Created reservations ['2aceeb66-071d-4fd7-a142-393106133807', '31d71ed1-8ce5-42ce-a555-585ad7d9d1ca', 'd7ed3b7d-4121-4566-b2f0-49da3c787114', '629c23e2-ec0e-442c-b76b-370ef435629e'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:52:42 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f31c993e-30a7-4fca-b4e6-af96577fb4e6 tempest-ServersNegativeTestJSON-1061367339 None] Lock "cinder-quobyte-8c58df9f-ecee-45eb-a648-37937c6d3043" acquired by "delete_volume" :: waited 0.039s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:52:42 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[54adeabd-6c9c-49bd-b96c-8fdd3f98ed60]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:52:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f31c993e-30a7-4fca-b4e6-af96577fb4e6 tempest-ServersNegativeTestJSON-1061367339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8c58df9f-ecee-45eb-a648-37937c6d3043 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c8586f07-bd1f-4c91-ac02-5a0faa08de6e tempest-AttachVolumeShelveTestJSON-499348625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:52:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c8586f07-bd1f-4c91-ac02-5a0faa08de6e tempest-AttachVolumeShelveTestJSON-499348625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:52:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c8586f07-bd1f-4c91-ac02-5a0faa08de6e tempest-AttachVolumeShelveTestJSON-499348625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:52:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c8586f07-bd1f-4c91-ac02-5a0faa08de6e tempest-AttachVolumeShelveTestJSON-499348625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:52:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c8586f07-bd1f-4c91-ac02-5a0faa08de6e tempest-AttachVolumeShelveTestJSON-499348625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:52:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c8586f07-bd1f-4c91-ac02-5a0faa08de6e tempest-AttachVolumeShelveTestJSON-499348625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:42 devstack sudo[92677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:52:42 devstack sudo[92677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:43 devstack sudo[92676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8c58df9f-ecee-45eb-a648-37937c6d3043
Sep 04 15:52:43 devstack sudo[92676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:43 devstack sudo[92677]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c8586f07-bd1f-4c91-ac02-5a0faa08de6e tempest-AttachVolumeShelveTestJSON-499348625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.457s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:43 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-c8586f07-bd1f-4c91-ac02-5a0faa08de6e tempest-AttachVolumeShelveTestJSON-499348625 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:52:43 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-c8586f07-bd1f-4c91-ac02-5a0faa08de6e tempest-AttachVolumeShelveTestJSON-499348625 None] Deleted volume successfully.
Sep 04 15:52:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c8586f07-bd1f-4c91-ac02-5a0faa08de6e tempest-AttachVolumeShelveTestJSON-499348625 None] Lock "cinder-287dabe0-5454-4935-a765-595f48247316-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:52:43 devstack sudo[92676]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f31c993e-30a7-4fca-b4e6-af96577fb4e6 tempest-ServersNegativeTestJSON-1061367339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8c58df9f-ecee-45eb-a648-37937c6d3043" returned: 0 in 0.745s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f31c993e-30a7-4fca-b4e6-af96577fb4e6 tempest-ServersNegativeTestJSON-1061367339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8c58df9f-ecee-45eb-a648-37937c6d3043 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:43 devstack sudo[92685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8c58df9f-ecee-45eb-a648-37937c6d3043
Sep 04 15:52:43 devstack sudo[92685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:44 devstack sudo[92685]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f31c993e-30a7-4fca-b4e6-af96577fb4e6 tempest-ServersNegativeTestJSON-1061367339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8c58df9f-ecee-45eb-a648-37937c6d3043" returned: 0 in 0.535s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f31c993e-30a7-4fca-b4e6-af96577fb4e6 tempest-ServersNegativeTestJSON-1061367339 None] Lock "cinder-quobyte-8c58df9f-ecee-45eb-a648-37937c6d3043" released by "delete_volume" :: held 1.355s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:52:44 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-f31c993e-30a7-4fca-b4e6-af96577fb4e6 tempest-ServersNegativeTestJSON-1061367339 None] Created reservations ['13d4c997-6f30-4458-84ec-94c7df2642af', '4aebe438-8609-4cd3-818c-533188243dbd', '7385ee0f-f504-4807-bf97-81c876e42cae', '16e9c97d-bddc-42ae-876a-99864cf8ef29'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:52:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f31c993e-30a7-4fca-b4e6-af96577fb4e6 tempest-ServersNegativeTestJSON-1061367339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:52:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f31c993e-30a7-4fca-b4e6-af96577fb4e6 tempest-ServersNegativeTestJSON-1061367339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:52:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f31c993e-30a7-4fca-b4e6-af96577fb4e6 tempest-ServersNegativeTestJSON-1061367339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:52:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f31c993e-30a7-4fca-b4e6-af96577fb4e6 tempest-ServersNegativeTestJSON-1061367339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:52:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f31c993e-30a7-4fca-b4e6-af96577fb4e6 tempest-ServersNegativeTestJSON-1061367339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:52:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f31c993e-30a7-4fca-b4e6-af96577fb4e6 tempest-ServersNegativeTestJSON-1061367339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:44 devstack sudo[92692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:52:44 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:44 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f31c993e-30a7-4fca-b4e6-af96577fb4e6 tempest-ServersNegativeTestJSON-1061367339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.363s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:44 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-f31c993e-30a7-4fca-b4e6-af96577fb4e6 tempest-ServersNegativeTestJSON-1061367339 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:52:44 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f31c993e-30a7-4fca-b4e6-af96577fb4e6 tempest-ServersNegativeTestJSON-1061367339 None] Deleted volume successfully.
Sep 04 15:52:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f31c993e-30a7-4fca-b4e6-af96577fb4e6 tempest-ServersNegativeTestJSON-1061367339 None] Lock "cinder-8c58df9f-ecee-45eb-a648-37937c6d3043-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:52:45 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-383ca375-a425-4123-a218-dd6e825f7468 tempest-ServersNegativeTestJSON-1061367339 None] Acquiring lock "cinder-dd821b97-f1ed-463b-8e11-968dfb398534-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:52:45 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-383ca375-a425-4123-a218-dd6e825f7468 tempest-ServersNegativeTestJSON-1061367339 None] Lock "cinder-dd821b97-f1ed-463b-8e11-968dfb398534-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:52:45 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-383ca375-a425-4123-a218-dd6e825f7468 tempest-ServersNegativeTestJSON-1061367339 None] Acquiring lock "cinder-quobyte-dd821b97-f1ed-463b-8e11-968dfb398534" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:52:45 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-383ca375-a425-4123-a218-dd6e825f7468 tempest-ServersNegativeTestJSON-1061367339 None] Lock "cinder-quobyte-dd821b97-f1ed-463b-8e11-968dfb398534" acquired by "delete_volume" :: waited 0.033s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:52:45 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9e37ed-92cc-47b8-ac0f-adefade9dda4]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:52:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-383ca375-a425-4123-a218-dd6e825f7468 tempest-ServersNegativeTestJSON-1061367339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dd821b97-f1ed-463b-8e11-968dfb398534 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:45 devstack sudo[92696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dd821b97-f1ed-463b-8e11-968dfb398534
Sep 04 15:52:45 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:46 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-383ca375-a425-4123-a218-dd6e825f7468 tempest-ServersNegativeTestJSON-1061367339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dd821b97-f1ed-463b-8e11-968dfb398534" returned: 0 in 0.824s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-383ca375-a425-4123-a218-dd6e825f7468 tempest-ServersNegativeTestJSON-1061367339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dd821b97-f1ed-463b-8e11-968dfb398534 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:46 devstack sudo[92725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dd821b97-f1ed-463b-8e11-968dfb398534
Sep 04 15:52:46 devstack sudo[92725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:46 devstack sudo[92725]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-383ca375-a425-4123-a218-dd6e825f7468 tempest-ServersNegativeTestJSON-1061367339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dd821b97-f1ed-463b-8e11-968dfb398534" returned: 0 in 0.483s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:46 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-383ca375-a425-4123-a218-dd6e825f7468 tempest-ServersNegativeTestJSON-1061367339 None] Lock "cinder-quobyte-dd821b97-f1ed-463b-8e11-968dfb398534" released by "delete_volume" :: held 1.396s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:52:46 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-383ca375-a425-4123-a218-dd6e825f7468 tempest-ServersNegativeTestJSON-1061367339 None] Created reservations ['2e3a2b37-b9c0-4556-b936-1e0097a1b144', '30c5ecdd-6987-40bf-81a8-120777065050', 'a3126efb-df4e-4ef9-9e1b-ca55530b0f33', '8d172328-7732-4a18-8922-cc1714cd5df3'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:52:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-383ca375-a425-4123-a218-dd6e825f7468 tempest-ServersNegativeTestJSON-1061367339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:52:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-383ca375-a425-4123-a218-dd6e825f7468 tempest-ServersNegativeTestJSON-1061367339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:52:46 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-383ca375-a425-4123-a218-dd6e825f7468 tempest-ServersNegativeTestJSON-1061367339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:52:46 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-383ca375-a425-4123-a218-dd6e825f7468 tempest-ServersNegativeTestJSON-1061367339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:52:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-383ca375-a425-4123-a218-dd6e825f7468 tempest-ServersNegativeTestJSON-1061367339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:52:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-383ca375-a425-4123-a218-dd6e825f7468 tempest-ServersNegativeTestJSON-1061367339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:46 devstack sudo[92729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:52:46 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:47 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-383ca375-a425-4123-a218-dd6e825f7468 tempest-ServersNegativeTestJSON-1061367339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.359s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:47 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-383ca375-a425-4123-a218-dd6e825f7468 tempest-ServersNegativeTestJSON-1061367339 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:52:47 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-383ca375-a425-4123-a218-dd6e825f7468 tempest-ServersNegativeTestJSON-1061367339 None] Deleted volume successfully.
Sep 04 15:52:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-383ca375-a425-4123-a218-dd6e825f7468 tempest-ServersNegativeTestJSON-1061367339 None] Lock "cinder-dd821b97-f1ed-463b-8e11-968dfb398534-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:52:48 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:52:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:52:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:52:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:52:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:52:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:52:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:48 devstack sudo[92756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:52:48 devstack sudo[92756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:49 devstack sudo[92756]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.427s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:49 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:52:49 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager._thread_info {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:52:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread count: 28 {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 15:52:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread info: [<_MainThread(MainThread, started 131673838448768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131673724603200)>, <Thread(Thread-3 (stat_writer), started daemon 131673723495936)>, <Thread(Rabbit-heartbeat, started daemon 131673723764800)>, <Thread(Thread-5 (_runner), started daemon 131673722269632)>, <Thread(Thread-7 (_runner), started daemon 131673722322112)>, <Thread(fd_logger, started daemon 131673722585024)>, <Thread(privsep_reader, started daemon 131673721593984)>, <Thread(tpool_thread_0, started daemon 131673714706112)>, <Thread(tpool_thread_1, started daemon 131673706313408)>, <Thread(tpool_thread_2, started daemon 131673697920704)>, <Thread(tpool_thread_3, started daemon 131673689528000)>, <Thread(tpool_thread_4, started daemon 131673681135296)>, <Thread(tpool_thread_5, started daemon 131673672726208)>, <Thread(tpool_thread_6, started daemon 131673664317120)>, <Thread(tpool_thread_7, started daemon 131673655908032)>, <Thread(tpool_thread_8, started daemon 131673647498944)>, <Thread(tpool_thread_9, started daemon 131673639089856)>, <Thread(tpool_thread_10, started daemon 131673630680768)>, <Thread(tpool_thread_11, started daemon 131673622271680)>, <Thread(tpool_thread_12, started daemon 131673613862592)>, <Thread(tpool_thread_13, started daemon 131673605453504)>, <Thread(tpool_thread_14, started daemon 131673597044416)>, <Thread(tpool_thread_15, started daemon 131673588635328)>, <Thread(tpool_thread_16, started daemon 131673580226240)>, <Thread(tpool_thread_17, started daemon 131673571817152)>, <Thread(tpool_thread_18, started daemon 131673563408064)>, <Thread(tpool_thread_19, started daemon 131673554998976)>] {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 15:52:54 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:UPDATE=44,cinder:SELECT=48,cinder:INSERT=17,cinder:DELETE=3 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:52:54 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=39,cinder:INSERT=16,cinder:UPDATE=51,cinder:DELETE=5 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:52:54 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-3990ae22-1743-42ff-ba5f-0d6957a56ca0 req-8c6221aa-1df4-44cc-9fdc-b4f27fed022b tempest-ServerActionsTestOtherA-701184065 None] Terminate volume connection completed successfully.
Sep 04 15:52:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-3990ae22-1743-42ff-ba5f-0d6957a56ca0 req-8c6221aa-1df4-44cc-9fdc-b4f27fed022b tempest-ServerActionsTestOtherA-701184065 None] Deleting attachment ec05f0d7-35a5-41f5-bfe3-652887242468. {{(pid=87504) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 15:52:58 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:52:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Flow 'volume_create_manager' (b039f2a7-9056-4609-9ea1-b63fa538dcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:52:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6587fe-f706-48d7-9e4d-f854b091d807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:52:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6587fe-f706-48d7-9e4d-f854b091d807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1411270068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0363e368-2d3e-43b6-97b0-078b68d4793a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70fadc39db7e4fc781d13904f8d28445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:59Z,use_quota=True,user_id='fce28aba09bf4f809afe39d66042f938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f821e15-e61d-4212-a53f-901fdaea6551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:52:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f821e15-e61d-4212-a53f-901fdaea6551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cae7b33-172a-496e-a835-39fae6811be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:52:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cae7b33-172a-496e-a835-39fae6811be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0363e368-2d3e-43b6-97b0-078b68d4793a', 'volume_name': 'volume-0363e368-2d3e-43b6-97b0-078b68d4793a', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5479029d-bb1c-4e49-96d5-751b0e9c3354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:52:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5479029d-bb1c-4e49-96d5-751b0e9c3354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf200904-7d0c-4f03-91f0-66c8dd6f5e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:52:58 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Volume 0363e368-2d3e-43b6-97b0-078b68d4793a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0363e368-2d3e-43b6-97b0-078b68d4793a', 'volume_size': 1}
Sep 04 15:52:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:52:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:52:58 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1411270068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0363e368-2d3e-43b6-97b0-078b68d4793a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70fadc39db7e4fc781d13904f8d28445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:59Z,use_quota=True,user_id='fce28aba09bf4f809afe39d66042f938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:52:58 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Creating volume 0363e368-2d3e-43b6-97b0-078b68d4793a {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:52:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:52:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:52:58 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:52:58 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:52:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:52:58 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:52:58 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:52:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:58 devstack sudo[92843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a 1073741824
Sep 04 15:52:58 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:59 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a 1073741824" returned: 0 in 0.467s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:52:59 devstack sudo[92849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a
Sep 04 15:52:59 devstack sudo[92849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:52:59 devstack sudo[92849]: pam_unix(sudo:session): session closed for user root
Sep 04 15:52:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a" returned: 0 in 0.360s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:52:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:52:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:52:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf200904-7d0c-4f03-91f0-66c8dd6f5e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0363e368-2d3e-43b6-97b0-078b68d4793a', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (647a2e74-c3f5-4b6a-a50a-c91cf5c0705b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:52:59 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Volume volume-0363e368-2d3e-43b6-97b0-078b68d4793a (0363e368-2d3e-43b6-97b0-078b68d4793a): created successfully
Sep 04 15:52:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (647a2e74-c3f5-4b6a-a50a-c91cf5c0705b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:52:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Flow 'volume_create_manager' (b039f2a7-9056-4609-9ea1-b63fa538dcba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:52:59 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-8450760e-0725-429b-b009-854f996c3862 req-2c9e812b-1101-42ee-9adb-d21823284fc7 tempest-VolumesSnapshotsTestJSON-2103513033 None] Created volume successfully.
Sep 04 15:53:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-3990ae22-1743-42ff-ba5f-0d6957a56ca0 req-1696a6c1-1d30-4cab-8337-110fae148e7c tempest-ServerActionsTestOtherA-701184065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-3990ae22-1743-42ff-ba5f-0d6957a56ca0 req-1696a6c1-1d30-4cab-8337-110fae148e7c tempest-ServerActionsTestOtherA-701184065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-3990ae22-1743-42ff-ba5f-0d6957a56ca0 req-1696a6c1-1d30-4cab-8337-110fae148e7c tempest-ServerActionsTestOtherA-701184065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-3990ae22-1743-42ff-ba5f-0d6957a56ca0 req-1696a6c1-1d30-4cab-8337-110fae148e7c tempest-ServerActionsTestOtherA-701184065 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236', 'name': 'volume-e724e03d-0fe6-4989-ba1b-7790d4d68e27', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4fc631b0-4558-4950-9b6c-9cc10e48d0c0', 'enforce_multipath': True} {{(pid=87504) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 15:53:00 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-3990ae22-1743-42ff-ba5f-0d6957a56ca0 req-1696a6c1-1d30-4cab-8337-110fae148e7c tempest-ServerActionsTestOtherA-701184065 None] attachment_update completed successfully.
Sep 04 15:53:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-5d57c2de-eff0-49f5-8761-a7803d532d17 req-f1848728-0664-4da2-bb72-e17e58a0785c tempest-VolumesSnapshotsTestJSON-2103513033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-5d57c2de-eff0-49f5-8761-a7803d532d17 req-f1848728-0664-4da2-bb72-e17e58a0785c tempest-VolumesSnapshotsTestJSON-2103513033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:01 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [req-5d57c2de-eff0-49f5-8761-a7803d532d17 req-f1848728-0664-4da2-bb72-e17e58a0785c tempest-VolumesSnapshotsTestJSON-2103513033 None] Creating offline snapshot ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250 of volume 0363e368-2d3e-43b6-97b0-078b68d4793a {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:53:01 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcb0ebc-8109-4d72-8509-01200488717f]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:53:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-5d57c2de-eff0-49f5-8761-a7803d532d17 req-f1848728-0664-4da2-bb72-e17e58a0785c tempest-VolumesSnapshotsTestJSON-2103513033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:01 devstack sudo[92928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a
Sep 04 15:53:01 devstack sudo[92928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:02 devstack sudo[92928]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-5d57c2de-eff0-49f5-8761-a7803d532d17 req-f1848728-0664-4da2-bb72-e17e58a0785c tempest-VolumesSnapshotsTestJSON-2103513033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a" returned: 0 in 0.828s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-5d57c2de-eff0-49f5-8761-a7803d532d17 req-f1848728-0664-4da2-bb72-e17e58a0785c tempest-VolumesSnapshotsTestJSON-2103513033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:02 devstack sudo[93276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250 1G
Sep 04 15:53:02 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:03 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-5d57c2de-eff0-49f5-8761-a7803d532d17 req-f1848728-0664-4da2-bb72-e17e58a0785c tempest-VolumesSnapshotsTestJSON-2103513033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250 1G" returned: 0 in 0.662s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-5d57c2de-eff0-49f5-8761-a7803d532d17 req-f1848728-0664-4da2-bb72-e17e58a0785c tempest-VolumesSnapshotsTestJSON-2103513033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0363e368-2d3e-43b6-97b0-078b68d4793a -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:03 devstack sudo[93289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0363e368-2d3e-43b6-97b0-078b68d4793a -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250
Sep 04 15:53:03 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:03 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-5d57c2de-eff0-49f5-8761-a7803d532d17 req-f1848728-0664-4da2-bb72-e17e58a0785c tempest-VolumesSnapshotsTestJSON-2103513033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0363e368-2d3e-43b6-97b0-078b68d4793a -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250" returned: 0 in 0.674s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:03 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [req-5d57c2de-eff0-49f5-8761-a7803d532d17 req-f1848728-0664-4da2-bb72-e17e58a0785c tempest-VolumesSnapshotsTestJSON-2103513033 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250 is being set with open permissions: ugo+rw
Sep 04 15:53:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-5d57c2de-eff0-49f5-8761-a7803d532d17 req-f1848728-0664-4da2-bb72-e17e58a0785c tempest-VolumesSnapshotsTestJSON-2103513033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:03 devstack sudo[93296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250
Sep 04 15:53:03 devstack sudo[93296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:04 devstack sudo[93296]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-5d57c2de-eff0-49f5-8761-a7803d532d17 req-f1848728-0664-4da2-bb72-e17e58a0785c tempest-VolumesSnapshotsTestJSON-2103513033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250" returned: 0 in 0.531s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-5d57c2de-eff0-49f5-8761-a7803d532d17 req-f1848728-0664-4da2-bb72-e17e58a0785c tempest-VolumesSnapshotsTestJSON-2103513033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:04 devstack sudo[93301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.info
Sep 04 15:53:04 devstack sudo[93301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:04 devstack sudo[93301]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-5d57c2de-eff0-49f5-8761-a7803d532d17 req-f1848728-0664-4da2-bb72-e17e58a0785c tempest-VolumesSnapshotsTestJSON-2103513033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.info" returned: 0 in 0.475s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:04 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [req-5d57c2de-eff0-49f5-8761-a7803d532d17 req-f1848728-0664-4da2-bb72-e17e58a0785c tempest-VolumesSnapshotsTestJSON-2103513033 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.info is being set with open permissions: ugo+rw
Sep 04 15:53:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-5d57c2de-eff0-49f5-8761-a7803d532d17 req-f1848728-0664-4da2-bb72-e17e58a0785c tempest-VolumesSnapshotsTestJSON-2103513033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:04 devstack sudo[93304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.info
Sep 04 15:53:04 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:05 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-5d57c2de-eff0-49f5-8761-a7803d532d17 req-f1848728-0664-4da2-bb72-e17e58a0785c tempest-VolumesSnapshotsTestJSON-2103513033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.info" returned: 0 in 0.570s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-5d57c2de-eff0-49f5-8761-a7803d532d17 req-f1848728-0664-4da2-bb72-e17e58a0785c tempest-VolumesSnapshotsTestJSON-2103513033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.960s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:05 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-5d57c2de-eff0-49f5-8761-a7803d532d17 req-f1848728-0664-4da2-bb72-e17e58a0785c tempest-VolumesSnapshotsTestJSON-2103513033 None] Create snapshot completed successfully
Sep 04 15:53:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-6ccee2d0-bc1b-415d-9901-f74a28f3af30 req-781ab7bd-d208-4fdc-ad2d-679c896c7687 tempest-VolumesSnapshotsTestJSON-2103513033 None] Acquiring lock "cinder-ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:53:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-6ccee2d0-bc1b-415d-9901-f74a28f3af30 req-781ab7bd-d208-4fdc-ad2d-679c896c7687 tempest-VolumesSnapshotsTestJSON-2103513033 None] Lock "cinder-ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:53:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-6ccee2d0-bc1b-415d-9901-f74a28f3af30 req-781ab7bd-d208-4fdc-ad2d-679c896c7687 tempest-VolumesSnapshotsTestJSON-2103513033 None] Acquiring lock "cinder-quobyte-0363e368-2d3e-43b6-97b0-078b68d4793a" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:53:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-6ccee2d0-bc1b-415d-9901-f74a28f3af30 req-781ab7bd-d208-4fdc-ad2d-679c896c7687 tempest-VolumesSnapshotsTestJSON-2103513033 None] Lock "cinder-quobyte-0363e368-2d3e-43b6-97b0-078b68d4793a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:53:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-6ccee2d0-bc1b-415d-9901-f74a28f3af30 req-781ab7bd-d208-4fdc-ad2d-679c896c7687 tempest-VolumesSnapshotsTestJSON-2103513033 None] Acquiring lock "cinder-quobyte-ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:53:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-6ccee2d0-bc1b-415d-9901-f74a28f3af30 req-781ab7bd-d208-4fdc-ad2d-679c896c7687 tempest-VolumesSnapshotsTestJSON-2103513033 None] Lock "cinder-quobyte-ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:53:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [req-6ccee2d0-bc1b-415d-9901-f74a28f3af30 req-781ab7bd-d208-4fdc-ad2d-679c896c7687 tempest-VolumesSnapshotsTestJSON-2103513033 None] Deleting offline snapshot ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250 of volume 0363e368-2d3e-43b6-97b0-078b68d4793a {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 15:53:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [req-6ccee2d0-bc1b-415d-9901-f74a28f3af30 req-781ab7bd-d208-4fdc-ad2d-679c896c7687 tempest-VolumesSnapshotsTestJSON-2103513033 None] snapshot_file for this snap is: volume-0363e368-2d3e-43b6-97b0-078b68d4793a.ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 15:53:06 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8135634-809e-4014-af04-58749264cec6]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:53:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-6ccee2d0-bc1b-415d-9901-f74a28f3af30 req-781ab7bd-d208-4fdc-ad2d-679c896c7687 tempest-VolumesSnapshotsTestJSON-2103513033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:06 devstack sudo[93308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250
Sep 04 15:53:06 devstack sudo[93308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:06 devstack sudo[93308]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-6ccee2d0-bc1b-415d-9901-f74a28f3af30 req-781ab7bd-d208-4fdc-ad2d-679c896c7687 tempest-VolumesSnapshotsTestJSON-2103513033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250" returned: 0 in 0.712s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [req-6ccee2d0-bc1b-415d-9901-f74a28f3af30 req-781ab7bd-d208-4fdc-ad2d-679c896c7687 tempest-VolumesSnapshotsTestJSON-2103513033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0363e368-2d3e-43b6-97b0-078b68d4793a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:53:07 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a5c363-9db4-4917-97ef-10fae6bfe7ee]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:53:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-6ccee2d0-bc1b-415d-9901-f74a28f3af30 req-781ab7bd-d208-4fdc-ad2d-679c896c7687 tempest-VolumesSnapshotsTestJSON-2103513033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:07 devstack sudo[93315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a
Sep 04 15:53:07 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:07 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-6ccee2d0-bc1b-415d-9901-f74a28f3af30 req-781ab7bd-d208-4fdc-ad2d-679c896c7687 tempest-VolumesSnapshotsTestJSON-2103513033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a" returned: 0 in 0.786s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-6ccee2d0-bc1b-415d-9901-f74a28f3af30 req-781ab7bd-d208-4fdc-ad2d-679c896c7687 tempest-VolumesSnapshotsTestJSON-2103513033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:07 devstack sudo[93320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250
Sep 04 15:53:07 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:08 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-6ccee2d0-bc1b-415d-9901-f74a28f3af30 req-781ab7bd-d208-4fdc-ad2d-679c896c7687 tempest-VolumesSnapshotsTestJSON-2103513033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250" returned: 0 in 0.802s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-6ccee2d0-bc1b-415d-9901-f74a28f3af30 req-781ab7bd-d208-4fdc-ad2d-679c896c7687 tempest-VolumesSnapshotsTestJSON-2103513033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:08 devstack sudo[93327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250
Sep 04 15:53:08 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:09 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-6ccee2d0-bc1b-415d-9901-f74a28f3af30 req-781ab7bd-d208-4fdc-ad2d-679c896c7687 tempest-VolumesSnapshotsTestJSON-2103513033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a.ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250" returned: 0 in 0.656s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:09 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-6ccee2d0-bc1b-415d-9901-f74a28f3af30 req-781ab7bd-d208-4fdc-ad2d-679c896c7687 tempest-VolumesSnapshotsTestJSON-2103513033 None] Lock "cinder-quobyte-ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250" released by "_delete_snapshot" :: held 3.227s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:53:09 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-6ccee2d0-bc1b-415d-9901-f74a28f3af30 req-781ab7bd-d208-4fdc-ad2d-679c896c7687 tempest-VolumesSnapshotsTestJSON-2103513033 None] Lock "cinder-quobyte-0363e368-2d3e-43b6-97b0-078b68d4793a" released by "delete_snapshot" :: held 3.268s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:53:09 devstack cinder-volume[87504]: WARNING cinder.quota [req-6ccee2d0-bc1b-415d-9901-f74a28f3af30 req-781ab7bd-d208-4fdc-ad2d-679c896c7687 tempest-VolumesSnapshotsTestJSON-2103513033 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 04 15:53:09 devstack cinder-volume[87504]: DEBUG cinder.quota [req-6ccee2d0-bc1b-415d-9901-f74a28f3af30 req-781ab7bd-d208-4fdc-ad2d-679c896c7687 tempest-VolumesSnapshotsTestJSON-2103513033 None] Created reservations ['f8f874d0-b9d8-4013-a8a5-2fad0a5b5cdf', '902917a0-269b-45e6-8ded-08c188b60d0e', 'aef6c14c-7eb6-4461-9507-04277a8ba280', '62e1ef40-f2c0-415a-84d4-7923991e5d39'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:53:09 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-6ccee2d0-bc1b-415d-9901-f74a28f3af30 req-781ab7bd-d208-4fdc-ad2d-679c896c7687 tempest-VolumesSnapshotsTestJSON-2103513033 None] Delete snapshot completed successfully.
Sep 04 15:53:09 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-6ccee2d0-bc1b-415d-9901-f74a28f3af30 req-781ab7bd-d208-4fdc-ad2d-679c896c7687 tempest-VolumesSnapshotsTestJSON-2103513033 None] Lock "cinder-ada4bf6d-5e8e-4ea5-a9b6-22d9c54ea250-delete_snapshot" released by "delete_snapshot" :: held 3.639s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:53:10 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-6ecf4484-3758-4543-9dc0-b370b1a1ef54 req-1e573fbf-6a93-4236-8632-f4d380efa296 tempest-VolumesSnapshotsTestJSON-2103513033 None] Acquiring lock "cinder-0363e368-2d3e-43b6-97b0-078b68d4793a-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:53:10 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-6ecf4484-3758-4543-9dc0-b370b1a1ef54 req-1e573fbf-6a93-4236-8632-f4d380efa296 tempest-VolumesSnapshotsTestJSON-2103513033 None] Lock "cinder-0363e368-2d3e-43b6-97b0-078b68d4793a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:53:10 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-6ecf4484-3758-4543-9dc0-b370b1a1ef54 req-1e573fbf-6a93-4236-8632-f4d380efa296 tempest-VolumesSnapshotsTestJSON-2103513033 None] Acquiring lock "cinder-quobyte-0363e368-2d3e-43b6-97b0-078b68d4793a" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:53:11 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-6ecf4484-3758-4543-9dc0-b370b1a1ef54 req-1e573fbf-6a93-4236-8632-f4d380efa296 tempest-VolumesSnapshotsTestJSON-2103513033 None] Lock "cinder-quobyte-0363e368-2d3e-43b6-97b0-078b68d4793a" acquired by "delete_volume" :: waited 0.043s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:53:11 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8259566-0a71-4fd6-b538-217dff17af87]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:53:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-6ecf4484-3758-4543-9dc0-b370b1a1ef54 req-1e573fbf-6a93-4236-8632-f4d380efa296 tempest-VolumesSnapshotsTestJSON-2103513033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:11 devstack sudo[93330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a
Sep 04 15:53:11 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:11 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-6ecf4484-3758-4543-9dc0-b370b1a1ef54 req-1e573fbf-6a93-4236-8632-f4d380efa296 tempest-VolumesSnapshotsTestJSON-2103513033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a" returned: 0 in 0.816s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-6ecf4484-3758-4543-9dc0-b370b1a1ef54 req-1e573fbf-6a93-4236-8632-f4d380efa296 tempest-VolumesSnapshotsTestJSON-2103513033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:11 devstack sudo[93335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a
Sep 04 15:53:11 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:12 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-6ecf4484-3758-4543-9dc0-b370b1a1ef54 req-1e573fbf-6a93-4236-8632-f4d380efa296 tempest-VolumesSnapshotsTestJSON-2103513033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0363e368-2d3e-43b6-97b0-078b68d4793a" returned: 0 in 0.789s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:12 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-6ecf4484-3758-4543-9dc0-b370b1a1ef54 req-1e573fbf-6a93-4236-8632-f4d380efa296 tempest-VolumesSnapshotsTestJSON-2103513033 None] Lock "cinder-quobyte-0363e368-2d3e-43b6-97b0-078b68d4793a" released by "delete_volume" :: held 1.730s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:53:12 devstack cinder-volume[87504]: DEBUG cinder.quota [req-6ecf4484-3758-4543-9dc0-b370b1a1ef54 req-1e573fbf-6a93-4236-8632-f4d380efa296 tempest-VolumesSnapshotsTestJSON-2103513033 None] Created reservations ['dddd0935-b680-4381-82c4-ab5611a70acd', '63dd03d3-6f56-4044-a56a-fb6985117670', '80559192-0692-4d05-8467-92a29de522bc', 'caa39fda-5cf5-4e06-a33e-9ef82d5c5ee8'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:53:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-6ecf4484-3758-4543-9dc0-b370b1a1ef54 req-1e573fbf-6a93-4236-8632-f4d380efa296 tempest-VolumesSnapshotsTestJSON-2103513033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-6ecf4484-3758-4543-9dc0-b370b1a1ef54 req-1e573fbf-6a93-4236-8632-f4d380efa296 tempest-VolumesSnapshotsTestJSON-2103513033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [req-6ecf4484-3758-4543-9dc0-b370b1a1ef54 req-1e573fbf-6a93-4236-8632-f4d380efa296 tempest-VolumesSnapshotsTestJSON-2103513033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:53:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [req-6ecf4484-3758-4543-9dc0-b370b1a1ef54 req-1e573fbf-6a93-4236-8632-f4d380efa296 tempest-VolumesSnapshotsTestJSON-2103513033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:53:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-6ecf4484-3758-4543-9dc0-b370b1a1ef54 req-1e573fbf-6a93-4236-8632-f4d380efa296 tempest-VolumesSnapshotsTestJSON-2103513033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-6ecf4484-3758-4543-9dc0-b370b1a1ef54 req-1e573fbf-6a93-4236-8632-f4d380efa296 tempest-VolumesSnapshotsTestJSON-2103513033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:13 devstack sudo[93338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:53:13 devstack sudo[93338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:13 devstack sudo[93338]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-6ecf4484-3758-4543-9dc0-b370b1a1ef54 req-1e573fbf-6a93-4236-8632-f4d380efa296 tempest-VolumesSnapshotsTestJSON-2103513033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.488s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:13 devstack cinder-volume[87504]: DEBUG cinder.manager [req-6ecf4484-3758-4543-9dc0-b370b1a1ef54 req-1e573fbf-6a93-4236-8632-f4d380efa296 tempest-VolumesSnapshotsTestJSON-2103513033 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:53:13 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-6ecf4484-3758-4543-9dc0-b370b1a1ef54 req-1e573fbf-6a93-4236-8632-f4d380efa296 tempest-VolumesSnapshotsTestJSON-2103513033 None] Deleted volume successfully.
Sep 04 15:53:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-6ecf4484-3758-4543-9dc0-b370b1a1ef54 req-1e573fbf-6a93-4236-8632-f4d380efa296 tempest-VolumesSnapshotsTestJSON-2103513033 None] Lock "cinder-0363e368-2d3e-43b6-97b0-078b68d4793a-delete_volume" released by "delete_volume" :: held 2.704s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:53:20 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-5fe65479-eb33-473e-9e11-915a933d6a63 tempest-GroupSnapshotsTest-696014180 None] Group tempest-GroupSnapshotsTest-Group-223405717: creating
Sep 04 15:53:20 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-5fe65479-eb33-473e-9e11-915a933d6a63 tempest-GroupSnapshotsTest-696014180 None] Group tempest-GroupSnapshotsTest-Group-223405717: created successfully
Sep 04 15:53:20 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-5fe65479-eb33-473e-9e11-915a933d6a63 tempest-GroupSnapshotsTest-696014180 None] Create group completed successfully.
Sep 04 15:53:21 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-95fe2091-0dc4-43b9-a90a-7a5293148384 tempest-GroupsTest-963774338 None] Group tempest-Group1-1229272037: creating
Sep 04 15:53:21 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-95fe2091-0dc4-43b9-a90a-7a5293148384 tempest-GroupsTest-963774338 None] Group tempest-Group1-1229272037: created successfully
Sep 04 15:53:21 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-95fe2091-0dc4-43b9-a90a-7a5293148384 tempest-GroupsTest-963774338 None] Create group completed successfully.
Sep 04 15:53:22 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:53:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Flow 'volume_create_manager' (13b5805e-072f-4f47-9d61-9ab256869f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:53:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc466abd-c43b-4a76-8477-7c54397c5849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc466abd-c43b-4a76-8477-7c54397c5849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-786309761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=93b9a355-c18e-4b5f-964d-6ef155dec84d,host='devstack@QuobyteHD#QuobyteHD',id=d56d828f-5e6c-4094-a5f6-ec269289ed1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724e2b57c44a420f801eee3ae9e4f189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:22Z,use_quota=True,user_id='e8a90017b307406c83691843dccb3631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d38bf9f5-9b2e-414a-baf3-85963680f9ad),volume_type_id=d38bf9f5-9b2e-414a-baf3-85963680f9ad)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8107f982-bed6-4931-827e-f46d3eb53647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8107f982-bed6-4931-827e-f46d3eb53647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7bbc5f2-492a-40bf-b122-2b55e4b0fafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7bbc5f2-492a-40bf-b122-2b55e4b0fafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd56d828f-5e6c-4094-a5f6-ec269289ed1c', 'volume_name': 'volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c080c71-d6e2-4c43-9aaf-f62335ff6d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c080c71-d6e2-4c43-9aaf-f62335ff6d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711bd3f0-4bc9-4f0a-b739-187e3b9113d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:22 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Volume d56d828f-5e6c-4094-a5f6-ec269289ed1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c', 'volume_size': 1}
Sep 04 15:53:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=93b9a355-c18e-4b5f-964d-6ef155dec84d,created_at=2026-09-04T13:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-786309761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=93b9a355-c18e-4b5f-964d-6ef155dec84d,host='devstack@QuobyteHD#QuobyteHD',id=d56d828f-5e6c-4094-a5f6-ec269289ed1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724e2b57c44a420f801eee3ae9e4f189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:22Z,use_quota=True,user_id='e8a90017b307406c83691843dccb3631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d38bf9f5-9b2e-414a-baf3-85963680f9ad),volume_type_id=d38bf9f5-9b2e-414a-baf3-85963680f9ad)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:53:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Creating volume d56d828f-5e6c-4094-a5f6-ec269289ed1c {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:53:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:53:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:53:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:53:22 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:53:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:22 devstack sudo[93403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c 1073741824
Sep 04 15:53:22 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:22 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-19580c85-abad-4d8a-9d88-3637666c305b tempest-GroupsTest-963774338 None] Group tempest-Group2-253531116: creating
Sep 04 15:53:22 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-19580c85-abad-4d8a-9d88-3637666c305b tempest-GroupsTest-963774338 None] Group tempest-Group2-253531116: created successfully
Sep 04 15:53:22 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-19580c85-abad-4d8a-9d88-3637666c305b tempest-GroupsTest-963774338 None] Create group completed successfully.
Sep 04 15:53:22 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c 1073741824" returned: 0 in 0.576s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:22 devstack sudo[93409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c
Sep 04 15:53:22 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:23 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c" returned: 0 in 0.294s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:53:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:23 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711bd3f0-4bc9-4f0a-b739-187e3b9113d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:23 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3484cd26-d068-4d9b-849e-4eb7b19c3997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:23 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Volume volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c (d56d828f-5e6c-4094-a5f6-ec269289ed1c): created successfully
Sep 04 15:53:23 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3484cd26-d068-4d9b-849e-4eb7b19c3997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:23 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Flow 'volume_create_manager' (13b5805e-072f-4f47-9d61-9ab256869f9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:53:23 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-5847e37a-2ddd-4eeb-af84-33adc93e2f56 tempest-GroupSnapshotsTest-696014180 None] Created volume successfully.
Sep 04 15:53:25 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:53:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Flow 'volume_create_manager' (a2344e3c-5036-4e55-9bf2-7cc5b53ad8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:53:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa9cb32-a471-4243-96c0-b1dffd544847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa9cb32-a471-4243-96c0-b1dffd544847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-929426138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9304024c-28e3-4219-91d0-f6a5345c853d,host='devstack@QuobyteHD#QuobyteHD',id=e198d1b9-9d01-457d-9a28-10597b9ca05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8587eac7583b4ad99c1f61d66bebb67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:25Z,use_quota=True,user_id='4b7b537ebbee4d43bc20f7411a9dc44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45ba86da-1898-4de8-a2e2-565a26404aff),volume_type_id=45ba86da-1898-4de8-a2e2-565a26404aff)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bcc5fe7-d4e9-4d1b-9af7-da84aba8344d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bcc5fe7-d4e9-4d1b-9af7-da84aba8344d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da04ca9b-6c6b-4446-91b4-78db75c66262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da04ca9b-6c6b-4446-91b4-78db75c66262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e198d1b9-9d01-457d-9a28-10597b9ca05c', 'volume_name': 'volume-e198d1b9-9d01-457d-9a28-10597b9ca05c', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d62cb87-d893-440a-80e8-3a6b7f202cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d62cb87-d893-440a-80e8-3a6b7f202cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08a042e3-915d-428b-845e-0cb86fd232c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:25 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Volume e198d1b9-9d01-457d-9a28-10597b9ca05c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e198d1b9-9d01-457d-9a28-10597b9ca05c', 'volume_size': 1}
Sep 04 15:53:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:25 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9304024c-28e3-4219-91d0-f6a5345c853d,created_at=2026-09-04T13:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-929426138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9304024c-28e3-4219-91d0-f6a5345c853d,host='devstack@QuobyteHD#QuobyteHD',id=e198d1b9-9d01-457d-9a28-10597b9ca05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8587eac7583b4ad99c1f61d66bebb67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:25Z,use_quota=True,user_id='4b7b537ebbee4d43bc20f7411a9dc44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45ba86da-1898-4de8-a2e2-565a26404aff),volume_type_id=45ba86da-1898-4de8-a2e2-565a26404aff)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:53:25 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Creating volume e198d1b9-9d01-457d-9a28-10597b9ca05c {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:53:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:25 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:53:25 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:53:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:25 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:53:25 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:53:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e198d1b9-9d01-457d-9a28-10597b9ca05c 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:25 devstack sudo[93482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e198d1b9-9d01-457d-9a28-10597b9ca05c 1073741824
Sep 04 15:53:25 devstack sudo[93482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:25 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-19b57ed7-eb76-4a27-ba87-9693b67bb78a tempest-GroupSnapshotsTest-696014180 None] GroupSnapshot 0a2548fb-6aeb-4a94-af45-5d61c79099df: creating.
Sep 04 15:53:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-19b57ed7-eb76-4a27-ba87-9693b67bb78a tempest-GroupSnapshotsTest-696014180 None] Group snapshot 0a2548fb-6aeb-4a94-af45-5d61c79099df: creating. {{(pid=87504) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 04 15:53:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-19b57ed7-eb76-4a27-ba87-9693b67bb78a tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:26 devstack sudo[93482]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e198d1b9-9d01-457d-9a28-10597b9ca05c 1073741824" returned: 0 in 0.736s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e198d1b9-9d01-457d-9a28-10597b9ca05c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:26 devstack sudo[93490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e198d1b9-9d01-457d-9a28-10597b9ca05c
Sep 04 15:53:26 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:26 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e198d1b9-9d01-457d-9a28-10597b9ca05c" returned: 0 in 0.297s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:53:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-19b57ed7-eb76-4a27-ba87-9693b67bb78a tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.911s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08a042e3-915d-428b-845e-0cb86fd232c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e198d1b9-9d01-457d-9a28-10597b9ca05c', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f129ee6-54cf-4b11-ab50-d7da9dcdcbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-19b57ed7-eb76-4a27-ba87-9693b67bb78a tempest-GroupSnapshotsTest-696014180 None] Creating offline snapshot 512ab7bc-351c-40d2-8b06-fbc3c7957f31 of volume d56d828f-5e6c-4094-a5f6-ec269289ed1c {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:53:26 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Volume volume-e198d1b9-9d01-457d-9a28-10597b9ca05c (e198d1b9-9d01-457d-9a28-10597b9ca05c): created successfully
Sep 04 15:53:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f129ee6-54cf-4b11-ab50-d7da9dcdcbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Flow 'volume_create_manager' (a2344e3c-5036-4e55-9bf2-7cc5b53ad8d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:53:26 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e705041-969a-41d5-893a-e7aab66db2a1]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:53:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-19b57ed7-eb76-4a27-ba87-9693b67bb78a tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:26 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-2d5cc5d6-7b66-4bcd-80da-a116dc626b96 tempest-GroupsTest-963774338 None] Created volume successfully.
Sep 04 15:53:26 devstack sudo[93493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c
Sep 04 15:53:26 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:26 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-19b57ed7-eb76-4a27-ba87-9693b67bb78a tempest-GroupSnapshotsTest-696014180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c" returned: 0 in 0.440s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-19b57ed7-eb76-4a27-ba87-9693b67bb78a tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.512ab7bc-351c-40d2-8b06-fbc3c7957f31 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:26 devstack sudo[93498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.512ab7bc-351c-40d2-8b06-fbc3c7957f31 1G
Sep 04 15:53:26 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:27 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-19b57ed7-eb76-4a27-ba87-9693b67bb78a tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.512ab7bc-351c-40d2-8b06-fbc3c7957f31 1G" returned: 0 in 0.504s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-19b57ed7-eb76-4a27-ba87-9693b67bb78a tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.512ab7bc-351c-40d2-8b06-fbc3c7957f31 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:27 devstack sudo[93504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.512ab7bc-351c-40d2-8b06-fbc3c7957f31
Sep 04 15:53:27 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:27 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-19b57ed7-eb76-4a27-ba87-9693b67bb78a tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.512ab7bc-351c-40d2-8b06-fbc3c7957f31" returned: 0 in 0.411s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:27 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-19b57ed7-eb76-4a27-ba87-9693b67bb78a tempest-GroupSnapshotsTest-696014180 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.512ab7bc-351c-40d2-8b06-fbc3c7957f31 is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 15:53:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-19b57ed7-eb76-4a27-ba87-9693b67bb78a tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.512ab7bc-351c-40d2-8b06-fbc3c7957f31 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:27 devstack sudo[93509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.512ab7bc-351c-40d2-8b06-fbc3c7957f31
Sep 04 15:53:27 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:28 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-19b57ed7-eb76-4a27-ba87-9693b67bb78a tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.512ab7bc-351c-40d2-8b06-fbc3c7957f31" returned: 0 in 0.390s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-19b57ed7-eb76-4a27-ba87-9693b67bb78a tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:28 devstack sudo[93512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.info
Sep 04 15:53:28 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:28 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-19b57ed7-eb76-4a27-ba87-9693b67bb78a tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.info" returned: 0 in 0.435s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:28 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-19b57ed7-eb76-4a27-ba87-9693b67bb78a tempest-GroupSnapshotsTest-696014180 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 15:53:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-19b57ed7-eb76-4a27-ba87-9693b67bb78a tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:28 devstack sudo[93516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.info
Sep 04 15:53:28 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:28 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ec38e18d-ba2a-4a71-b068-55557520ded7 tempest-GroupsTest-963774338 None] Acquiring lock "cinder-quobyte-e198d1b9-9d01-457d-9a28-10597b9ca05c" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:53:28 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ec38e18d-ba2a-4a71-b068-55557520ded7 tempest-GroupsTest-963774338 None] Lock "cinder-quobyte-e198d1b9-9d01-457d-9a28-10597b9ca05c" acquired by "delete_volume" :: waited 0.031s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:53:28 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[21034133-d621-408f-8e58-35beb99989f1]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:53:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ec38e18d-ba2a-4a71-b068-55557520ded7 tempest-GroupsTest-963774338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e198d1b9-9d01-457d-9a28-10597b9ca05c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:28 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-19b57ed7-eb76-4a27-ba87-9693b67bb78a tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.info" returned: 0 in 0.325s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-19b57ed7-eb76-4a27-ba87-9693b67bb78a tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.664s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:29 devstack sudo[93518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e198d1b9-9d01-457d-9a28-10597b9ca05c
Sep 04 15:53:29 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:29 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-19b57ed7-eb76-4a27-ba87-9693b67bb78a tempest-GroupSnapshotsTest-696014180 None] group_snapshot 0a2548fb-6aeb-4a94-af45-5d61c79099df: created successfully
Sep 04 15:53:29 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ec38e18d-ba2a-4a71-b068-55557520ded7 tempest-GroupsTest-963774338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e198d1b9-9d01-457d-9a28-10597b9ca05c" returned: 0 in 0.591s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ec38e18d-ba2a-4a71-b068-55557520ded7 tempest-GroupsTest-963774338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e198d1b9-9d01-457d-9a28-10597b9ca05c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:29 devstack sudo[93525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e198d1b9-9d01-457d-9a28-10597b9ca05c
Sep 04 15:53:29 devstack sudo[93525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:29 devstack sudo[93525]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ec38e18d-ba2a-4a71-b068-55557520ded7 tempest-GroupsTest-963774338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e198d1b9-9d01-457d-9a28-10597b9ca05c" returned: 0 in 0.469s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:29 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ec38e18d-ba2a-4a71-b068-55557520ded7 tempest-GroupsTest-963774338 None] Lock "cinder-quobyte-e198d1b9-9d01-457d-9a28-10597b9ca05c" released by "delete_volume" :: held 1.144s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:53:30 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-ec38e18d-ba2a-4a71-b068-55557520ded7 tempest-GroupsTest-963774338 None] Created reservations ['022560bf-1f2c-4759-ab7d-8c623108878a'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:53:30 devstack cinder-volume[87504]: WARNING cinder.quota [None req-ec38e18d-ba2a-4a71-b068-55557520ded7 tempest-GroupsTest-963774338 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-899482242 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-899482242, it is now deprecated. Please use the default quota class for default quota.
Sep 04 15:53:30 devstack cinder-volume[87504]: WARNING cinder.quota [None req-ec38e18d-ba2a-4a71-b068-55557520ded7 tempest-GroupsTest-963774338 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-899482242 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-899482242, it is now deprecated. Please use the default quota class for default quota.
Sep 04 15:53:30 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-ec38e18d-ba2a-4a71-b068-55557520ded7 tempest-GroupsTest-963774338 None] Created reservations ['00012a09-138d-480d-a964-2a4307889e6d', 'e6c235da-281a-449a-9f20-e63dd61e4144', '1a7908fd-e2be-44ea-a4c8-29ce4b4784c8', 'a044b8e1-5ff8-49b5-bcdc-85db4497c194'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:53:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ec38e18d-ba2a-4a71-b068-55557520ded7 tempest-GroupsTest-963774338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ec38e18d-ba2a-4a71-b068-55557520ded7 tempest-GroupsTest-963774338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:30 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ec38e18d-ba2a-4a71-b068-55557520ded7 tempest-GroupsTest-963774338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:53:30 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ec38e18d-ba2a-4a71-b068-55557520ded7 tempest-GroupsTest-963774338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:53:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ec38e18d-ba2a-4a71-b068-55557520ded7 tempest-GroupsTest-963774338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ec38e18d-ba2a-4a71-b068-55557520ded7 tempest-GroupsTest-963774338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:30 devstack sudo[93534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:53:30 devstack sudo[93534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:30 devstack sudo[93534]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ec38e18d-ba2a-4a71-b068-55557520ded7 tempest-GroupsTest-963774338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.439s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:30 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ec38e18d-ba2a-4a71-b068-55557520ded7 tempest-GroupsTest-963774338 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:53:30 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-ec38e18d-ba2a-4a71-b068-55557520ded7 tempest-GroupsTest-963774338 None] Delete group completed successfully.
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "cinder-quobyte-512ab7bc-351c-40d2-8b06-fbc3c7957f31-f144022f-019c-466f-b163-6db3eb22045c" by "_create_volume_from_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-512ab7bc-351c-40d2-8b06-fbc3c7957f31-f144022f-019c-466f-b163-6db3eb22045c" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Creating volume f144022f-019c-466f-b163-6db3eb22045c from snapshot 512ab7bc-351c-40d2-8b06-fbc3c7957f31 {{(pid=87504) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "cinder-quobyte-f144022f-019c-466f-b163-6db3eb22045c" by "_copy_volume_from_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-f144022f-019c-466f-b163-6db3eb22045c" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] snapshot: 512ab7bc-351c-40d2-8b06-fbc3c7957f31, volume: f144022f-019c-466f-b163-6db3eb22045c,  {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7235cfd1-8d4b-499f-ac73-9b6832d8b3e0]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.512ab7bc-351c-40d2-8b06-fbc3c7957f31 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:31 devstack sudo[93550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.512ab7bc-351c-40d2-8b06-fbc3c7957f31
Sep 04 15:53:31 devstack sudo[93550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-226335ad-0315-41c2-9939-4c5abf0a8516 tempest-GroupsTest-963774338 None] Created reservations ['1c708247-8ff4-4c4e-843c-8346eac3bcf2'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-226335ad-0315-41c2-9939-4c5abf0a8516 tempest-GroupsTest-963774338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-226335ad-0315-41c2-9939-4c5abf0a8516 tempest-GroupsTest-963774338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-226335ad-0315-41c2-9939-4c5abf0a8516 tempest-GroupsTest-963774338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-226335ad-0315-41c2-9939-4c5abf0a8516 tempest-GroupsTest-963774338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-226335ad-0315-41c2-9939-4c5abf0a8516 tempest-GroupsTest-963774338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-226335ad-0315-41c2-9939-4c5abf0a8516 tempest-GroupsTest-963774338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:31 devstack sudo[93566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:53:31 devstack sudo[93566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:31 devstack sudo[93550]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.512ab7bc-351c-40d2-8b06-fbc3c7957f31" returned: 0 in 0.715s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[524ef332-0105-48b3-a213-aa22894205bb]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:53:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:32 devstack sudo[93566]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-226335ad-0315-41c2-9939-4c5abf0a8516 tempest-GroupsTest-963774338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.397s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:32 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-226335ad-0315-41c2-9939-4c5abf0a8516 tempest-GroupsTest-963774338 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:53:32 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-226335ad-0315-41c2-9939-4c5abf0a8516 tempest-GroupsTest-963774338 None] Delete group completed successfully.
Sep 04 15:53:32 devstack sudo[93573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c
Sep 04 15:53:32 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:32 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c" returned: 0 in 0.487s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:32 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 04 15:53:32 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Creating direct copy from snapshot {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 04 15:53:32 devstack cinder-volume[87504]: DEBUG cinder.utils [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Path /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f144022f-019c-466f-b163-6db3eb22045c not found in is_blk_device check {{(pid=87504) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 04 15:53:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f144022f-019c-466f-b163-6db3eb22045c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:32 devstack sudo[93580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f144022f-019c-466f-b163-6db3eb22045c
Sep 04 15:53:32 devstack sudo[93580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:34 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e53b6107-9960-4ddd-8960-a82843093f81 tempest-GroupsTest-963774338 None] Group tempest-GroupsTest-Group-1044548874: creating
Sep 04 15:53:34 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e53b6107-9960-4ddd-8960-a82843093f81 tempest-GroupsTest-963774338 None] Group tempest-GroupsTest-Group-1044548874: created successfully
Sep 04 15:53:34 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e53b6107-9960-4ddd-8960-a82843093f81 tempest-GroupsTest-963774338 None] Create group completed successfully.
Sep 04 15:53:37 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:53:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Flow 'volume_create_manager' (af8c40d2-09d6-4a6f-929e-886aa458af6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:53:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87871727-b071-4767-9b84-a332488b0683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87871727-b071-4767-9b84-a332488b0683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1117639019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=77364b38-b746-4116-8a80-5c09de625475,host='devstack@QuobyteHD#QuobyteHD',id=69654cd0-c55f-4c36-aed7-52d7191a4514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8587eac7583b4ad99c1f61d66bebb67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:37Z,use_quota=True,user_id='4b7b537ebbee4d43bc20f7411a9dc44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de702bb8-101d-4eab-98cd-da4497a61378),volume_type_id=de702bb8-101d-4eab-98cd-da4497a61378)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73b05eb-a82c-49c2-beaa-9863a0714995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73b05eb-a82c-49c2-beaa-9863a0714995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ec4faf-75f7-4ee4-b1d3-cdb3e6e5ffcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ec4faf-75f7-4ee4-b1d3-cdb3e6e5ffcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69654cd0-c55f-4c36-aed7-52d7191a4514', 'volume_name': 'volume-69654cd0-c55f-4c36-aed7-52d7191a4514', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4367c95-5c72-4234-9850-4473b43368bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4367c95-5c72-4234-9850-4473b43368bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72aced40-ef59-409d-a729-40762e768ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:37 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Volume 69654cd0-c55f-4c36-aed7-52d7191a4514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69654cd0-c55f-4c36-aed7-52d7191a4514', 'volume_size': 1}
Sep 04 15:53:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:39 devstack sudo[93580]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f144022f-019c-466f-b163-6db3eb22045c" returned: 0 in 7.431s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:39 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c, size 1024.00 MB, duration 7.43 sec, destination /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f144022f-019c-466f-b163-6db3eb22045c {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 15:53:39 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Converted 1024.00 MB image at 137.78 MB/s
Sep 04 15:53:39 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f144022f-019c-466f-b163-6db3eb22045c is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 15:53:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f144022f-019c-466f-b163-6db3eb22045c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:39 devstack sudo[93665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f144022f-019c-466f-b163-6db3eb22045c
Sep 04 15:53:39 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:40 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f144022f-019c-466f-b163-6db3eb22045c" returned: 0 in 0.304s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:40 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-f144022f-019c-466f-b163-6db3eb22045c" released by "_copy_volume_from_snapshot" :: held 9.128s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:53:40 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-512ab7bc-351c-40d2-8b06-fbc3c7957f31-f144022f-019c-466f-b163-6db3eb22045c" released by "_create_volume_from_snapshot" :: held 9.228s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:53:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.254s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.508s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:40 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=77364b38-b746-4116-8a80-5c09de625475,created_at=2026-09-04T13:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1117639019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=77364b38-b746-4116-8a80-5c09de625475,host='devstack@QuobyteHD#QuobyteHD',id=69654cd0-c55f-4c36-aed7-52d7191a4514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8587eac7583b4ad99c1f61d66bebb67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:37Z,use_quota=True,user_id='4b7b537ebbee4d43bc20f7411a9dc44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de702bb8-101d-4eab-98cd-da4497a61378),volume_type_id=de702bb8-101d-4eab-98cd-da4497a61378)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:53:40 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Creating volume 69654cd0-c55f-4c36-aed7-52d7191a4514 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:53:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:40 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:53:40 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:53:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:40 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:53:40 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:53:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-69654cd0-c55f-4c36-aed7-52d7191a4514 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:40 devstack sudo[93670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-69654cd0-c55f-4c36-aed7-52d7191a4514 1073741824
Sep 04 15:53:40 devstack sudo[93670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:40 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-7fb76cda-bc94-4ec8-b76f-111c8c6ff0e2 tempest-GroupSnapshotsTest-696014180 None] Create group from source-snapshot-0a2548fb-6aeb-4a94-af45-5d61c79099df completed successfully.
Sep 04 15:53:40 devstack sudo[93670]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-69654cd0-c55f-4c36-aed7-52d7191a4514 1073741824" returned: 0 in 0.484s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-69654cd0-c55f-4c36-aed7-52d7191a4514 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:40 devstack sudo[93675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-69654cd0-c55f-4c36-aed7-52d7191a4514
Sep 04 15:53:40 devstack sudo[93675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:41 devstack sudo[93675]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-69654cd0-c55f-4c36-aed7-52d7191a4514" returned: 0 in 0.314s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:41 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:53:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72aced40-ef59-409d-a729-40762e768ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69654cd0-c55f-4c36-aed7-52d7191a4514', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da753e79-7ff6-469f-bf13-164d54293d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:41 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Volume volume-69654cd0-c55f-4c36-aed7-52d7191a4514 (69654cd0-c55f-4c36-aed7-52d7191a4514): created successfully
Sep 04 15:53:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da753e79-7ff6-469f-bf13-164d54293d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Flow 'volume_create_manager' (af8c40d2-09d6-4a6f-929e-886aa458af6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:53:41 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-0cf36b54-4ea8-4199-a3aa-f8db37954e9d tempest-GroupsTest-963774338 None] Created volume successfully.
Sep 04 15:53:41 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-04554c0d-009b-46bf-b377-d6a0a3474030 req-5fe017fb-4fc4-4fad-9ed2-e6fb11fe962e tempest-ServerActionsTestOtherA-701184065 None] Terminate volume connection completed successfully.
Sep 04 15:53:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-04554c0d-009b-46bf-b377-d6a0a3474030 req-5fe017fb-4fc4-4fad-9ed2-e6fb11fe962e tempest-ServerActionsTestOtherA-701184065 None] Deleting attachment 4fc631b0-4558-4950-9b6c-9cc10e48d0c0. {{(pid=87504) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 15:53:41 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-04554c0d-009b-46bf-b377-d6a0a3474030 req-d671e3fd-49e4-4050-9069-be9f6587e438 tempest-ServerActionsTestOtherA-701184065 None] Acquiring lock "cinder-e724e03d-0fe6-4989-ba1b-7790d4d68e27-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:53:41 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-04554c0d-009b-46bf-b377-d6a0a3474030 req-d671e3fd-49e4-4050-9069-be9f6587e438 tempest-ServerActionsTestOtherA-701184065 None] Lock "cinder-e724e03d-0fe6-4989-ba1b-7790d4d68e27-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-04554c0d-009b-46bf-b377-d6a0a3474030 req-d671e3fd-49e4-4050-9069-be9f6587e438 tempest-ServerActionsTestOtherA-701184065 None] Acquiring lock "cinder-quobyte-e724e03d-0fe6-4989-ba1b-7790d4d68e27" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-04554c0d-009b-46bf-b377-d6a0a3474030 req-d671e3fd-49e4-4050-9069-be9f6587e438 tempest-ServerActionsTestOtherA-701184065 None] Lock "cinder-quobyte-e724e03d-0fe6-4989-ba1b-7790d4d68e27" acquired by "delete_volume" :: waited 0.031s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[746f2936-79f1-4d1f-b7b8-898b390210ac]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-04554c0d-009b-46bf-b377-d6a0a3474030 req-d671e3fd-49e4-4050-9069-be9f6587e438 tempest-ServerActionsTestOtherA-701184065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e724e03d-0fe6-4989-ba1b-7790d4d68e27 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Flow 'volume_create_manager' (b496d82c-6925-46dc-840a-17bb3d6ec853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80206a4d-aa8d-4872-8e42-3dfa1eecaae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:42 devstack sudo[93680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e724e03d-0fe6-4989-ba1b-7790d4d68e27
Sep 04 15:53:42 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80206a4d-aa8d-4872-8e42-3dfa1eecaae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1647904023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=77364b38-b746-4116-8a80-5c09de625475,host='devstack@QuobyteHD#QuobyteHD',id=d4275fe9-567a-4ae6-b23c-7883587d87e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8587eac7583b4ad99c1f61d66bebb67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:42Z,use_quota=True,user_id='4b7b537ebbee4d43bc20f7411a9dc44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de702bb8-101d-4eab-98cd-da4497a61378),volume_type_id=de702bb8-101d-4eab-98cd-da4497a61378)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3829e2fc-b3ee-412f-a0de-6d2c383cce07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3829e2fc-b3ee-412f-a0de-6d2c383cce07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07805141-d300-4b38-9fa1-301b800763df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07805141-d300-4b38-9fa1-301b800763df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4275fe9-567a-4ae6-b23c-7883587d87e4', 'volume_name': 'volume-d4275fe9-567a-4ae6-b23c-7883587d87e4', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (461e2beb-3f8d-4fc4-bfe4-387373789ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (461e2beb-3f8d-4fc4-bfe4-387373789ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7b585b-6d07-420a-bdea-8f04ee723a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:42 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Volume d4275fe9-567a-4ae6-b23c-7883587d87e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4275fe9-567a-4ae6-b23c-7883587d87e4', 'volume_size': 1}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=77364b38-b746-4116-8a80-5c09de625475,created_at=2026-09-04T13:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1647904023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=77364b38-b746-4116-8a80-5c09de625475,host='devstack@QuobyteHD#QuobyteHD',id=d4275fe9-567a-4ae6-b23c-7883587d87e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8587eac7583b4ad99c1f61d66bebb67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:42Z,use_quota=True,user_id='4b7b537ebbee4d43bc20f7411a9dc44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de702bb8-101d-4eab-98cd-da4497a61378),volume_type_id=de702bb8-101d-4eab-98cd-da4497a61378)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Creating volume d4275fe9-567a-4ae6-b23c-7883587d87e4 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:53:42 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d4275fe9-567a-4ae6-b23c-7883587d87e4 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:42 devstack sudo[93682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d4275fe9-567a-4ae6-b23c-7883587d87e4 1073741824
Sep 04 15:53:42 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b4bda26c-1a28-428f-8ef1-466fbce556e3 tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "cinder-quobyte-f144022f-019c-466f-b163-6db3eb22045c" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b4bda26c-1a28-428f-8ef1-466fbce556e3 tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-f144022f-019c-466f-b163-6db3eb22045c" acquired by "delete_volume" :: waited 0.024s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[517fb5d4-30d2-49a3-af57-82be3f8feadf]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b4bda26c-1a28-428f-8ef1-466fbce556e3 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f144022f-019c-466f-b163-6db3eb22045c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:42 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-04554c0d-009b-46bf-b377-d6a0a3474030 req-d671e3fd-49e4-4050-9069-be9f6587e438 tempest-ServerActionsTestOtherA-701184065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e724e03d-0fe6-4989-ba1b-7790d4d68e27" returned: 0 in 0.475s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-04554c0d-009b-46bf-b377-d6a0a3474030 req-d671e3fd-49e4-4050-9069-be9f6587e438 tempest-ServerActionsTestOtherA-701184065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e724e03d-0fe6-4989-ba1b-7790d4d68e27 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:42 devstack sudo[93688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e724e03d-0fe6-4989-ba1b-7790d4d68e27
Sep 04 15:53:42 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:42 devstack sudo[93687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f144022f-019c-466f-b163-6db3eb22045c
Sep 04 15:53:42 devstack sudo[93687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:42 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-04554c0d-009b-46bf-b377-d6a0a3474030 req-d671e3fd-49e4-4050-9069-be9f6587e438 tempest-ServerActionsTestOtherA-701184065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e724e03d-0fe6-4989-ba1b-7790d4d68e27" returned: 0 in 0.323s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:42 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-04554c0d-009b-46bf-b377-d6a0a3474030 req-d671e3fd-49e4-4050-9069-be9f6587e438 tempest-ServerActionsTestOtherA-701184065 None] Lock "cinder-quobyte-e724e03d-0fe6-4989-ba1b-7790d4d68e27" released by "delete_volume" :: held 0.877s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:53:43 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d4275fe9-567a-4ae6-b23c-7883587d87e4 1073741824" returned: 0 in 0.643s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG cinder.quota [req-04554c0d-009b-46bf-b377-d6a0a3474030 req-d671e3fd-49e4-4050-9069-be9f6587e438 tempest-ServerActionsTestOtherA-701184065 None] Created reservations ['019c11c5-1466-4f6d-bd41-3bb160c3f017', '6e3b3c16-4257-40d8-a2a4-b37894e18e86', 'b8059493-2827-4fd8-bf71-9c8544919913', 'c0186f23-a063-4575-ae6d-f81dbb5d0083'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:53:43 devstack sudo[93687]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b4bda26c-1a28-428f-8ef1-466fbce556e3 tempest-GroupSnapshotsTest-696014180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f144022f-019c-466f-b163-6db3eb22045c" returned: 0 in 0.527s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b4bda26c-1a28-428f-8ef1-466fbce556e3 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f144022f-019c-466f-b163-6db3eb22045c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d4275fe9-567a-4ae6-b23c-7883587d87e4 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:43 devstack sudo[93699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f144022f-019c-466f-b163-6db3eb22045c
Sep 04 15:53:43 devstack sudo[93699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:43 devstack sudo[93700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d4275fe9-567a-4ae6-b23c-7883587d87e4
Sep 04 15:53:43 devstack sudo[93700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-04554c0d-009b-46bf-b377-d6a0a3474030 req-d671e3fd-49e4-4050-9069-be9f6587e438 tempest-ServerActionsTestOtherA-701184065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-04554c0d-009b-46bf-b377-d6a0a3474030 req-d671e3fd-49e4-4050-9069-be9f6587e438 tempest-ServerActionsTestOtherA-701184065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [req-04554c0d-009b-46bf-b377-d6a0a3474030 req-d671e3fd-49e4-4050-9069-be9f6587e438 tempest-ServerActionsTestOtherA-701184065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [req-04554c0d-009b-46bf-b377-d6a0a3474030 req-d671e3fd-49e4-4050-9069-be9f6587e438 tempest-ServerActionsTestOtherA-701184065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-04554c0d-009b-46bf-b377-d6a0a3474030 req-d671e3fd-49e4-4050-9069-be9f6587e438 tempest-ServerActionsTestOtherA-701184065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-04554c0d-009b-46bf-b377-d6a0a3474030 req-d671e3fd-49e4-4050-9069-be9f6587e438 tempest-ServerActionsTestOtherA-701184065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:43 devstack sudo[93703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:53:43 devstack sudo[93703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-61ec9a01-a34a-45d0-bed0-dbcd0dc75616 tempest-ServerActionsTestOtherA-701184065 None] Acquiring lock "cinder-8af91ef0-9bea-4ce9-9708-6a09805de990-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-61ec9a01-a34a-45d0-bed0-dbcd0dc75616 tempest-ServerActionsTestOtherA-701184065 None] Lock "cinder-8af91ef0-9bea-4ce9-9708-6a09805de990-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-61ec9a01-a34a-45d0-bed0-dbcd0dc75616 tempest-ServerActionsTestOtherA-701184065 None] Acquiring lock "cinder-quobyte-8af91ef0-9bea-4ce9-9708-6a09805de990" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-61ec9a01-a34a-45d0-bed0-dbcd0dc75616 tempest-ServerActionsTestOtherA-701184065 None] Lock "cinder-quobyte-8af91ef0-9bea-4ce9-9708-6a09805de990" acquired by "delete_volume" :: waited 0.037s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cc2b5b-539d-416c-8af9-9eb47f5f72fa]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-61ec9a01-a34a-45d0-bed0-dbcd0dc75616 tempest-ServerActionsTestOtherA-701184065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8af91ef0-9bea-4ce9-9708-6a09805de990 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:43 devstack sudo[93703]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-04554c0d-009b-46bf-b377-d6a0a3474030 req-d671e3fd-49e4-4050-9069-be9f6587e438 tempest-ServerActionsTestOtherA-701184065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.367s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:43 devstack sudo[93705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8af91ef0-9bea-4ce9-9708-6a09805de990
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG cinder.manager [req-04554c0d-009b-46bf-b377-d6a0a3474030 req-d671e3fd-49e4-4050-9069-be9f6587e438 tempest-ServerActionsTestOtherA-701184065 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:53:43 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:43 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-04554c0d-009b-46bf-b377-d6a0a3474030 req-d671e3fd-49e4-4050-9069-be9f6587e438 tempest-ServerActionsTestOtherA-701184065 None] Deleted volume successfully.
Sep 04 15:53:43 devstack sudo[93700]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d4275fe9-567a-4ae6-b23c-7883587d87e4" returned: 0 in 0.471s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:43 devstack sudo[93699]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b4bda26c-1a28-428f-8ef1-466fbce556e3 tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f144022f-019c-466f-b163-6db3eb22045c" returned: 0 in 0.503s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7b585b-6d07-420a-bdea-8f04ee723a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4275fe9-567a-4ae6-b23c-7883587d87e4', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7fceb05-adf6-41ad-ad3d-b6c5c4c17407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b4bda26c-1a28-428f-8ef1-466fbce556e3 tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-f144022f-019c-466f-b163-6db3eb22045c" released by "delete_volume" :: held 1.105s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-04554c0d-009b-46bf-b377-d6a0a3474030 req-d671e3fd-49e4-4050-9069-be9f6587e438 tempest-ServerActionsTestOtherA-701184065 None] Lock "cinder-e724e03d-0fe6-4989-ba1b-7790d4d68e27-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:53:43 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Volume volume-d4275fe9-567a-4ae6-b23c-7883587d87e4 (d4275fe9-567a-4ae6-b23c-7883587d87e4): created successfully
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7fceb05-adf6-41ad-ad3d-b6c5c4c17407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Flow 'volume_create_manager' (b496d82c-6925-46dc-840a-17bb3d6ec853) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:53:43 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-40af0094-0905-4c1d-beb5-1fb96015cf69 tempest-GroupsTest-963774338 None] Created volume successfully.
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-b4bda26c-1a28-428f-8ef1-466fbce556e3 tempest-GroupSnapshotsTest-696014180 None] Created reservations ['30a05b33-23f2-40a7-b672-c351dc916103'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:53:43 devstack cinder-volume[87504]: WARNING cinder.quota [None req-b4bda26c-1a28-428f-8ef1-466fbce556e3 tempest-GroupSnapshotsTest-696014180 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-396033693 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-396033693, it is now deprecated. Please use the default quota class for default quota.
Sep 04 15:53:43 devstack cinder-volume[87504]: WARNING cinder.quota [None req-b4bda26c-1a28-428f-8ef1-466fbce556e3 tempest-GroupSnapshotsTest-696014180 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-396033693 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-396033693, it is now deprecated. Please use the default quota class for default quota.
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-b4bda26c-1a28-428f-8ef1-466fbce556e3 tempest-GroupSnapshotsTest-696014180 None] Created reservations ['d81c8d5a-6ca2-4a00-84ba-1e9bf113559a', 'fbd526c9-6acb-4ddd-b421-1a83b750987e', '4a20b3f9-327d-4665-8c04-c48b959d8e0a', '4f57287a-d3cc-4b32-85e0-62428bca3269'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:53:43 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-61ec9a01-a34a-45d0-bed0-dbcd0dc75616 tempest-ServerActionsTestOtherA-701184065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8af91ef0-9bea-4ce9-9708-6a09805de990" returned: 0 in 0.492s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-61ec9a01-a34a-45d0-bed0-dbcd0dc75616 tempest-ServerActionsTestOtherA-701184065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8af91ef0-9bea-4ce9-9708-6a09805de990 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b4bda26c-1a28-428f-8ef1-466fbce556e3 tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b4bda26c-1a28-428f-8ef1-466fbce556e3 tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b4bda26c-1a28-428f-8ef1-466fbce556e3 tempest-GroupSnapshotsTest-696014180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b4bda26c-1a28-428f-8ef1-466fbce556e3 tempest-GroupSnapshotsTest-696014180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b4bda26c-1a28-428f-8ef1-466fbce556e3 tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b4bda26c-1a28-428f-8ef1-466fbce556e3 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:43 devstack sudo[93714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8af91ef0-9bea-4ce9-9708-6a09805de990
Sep 04 15:53:43 devstack sudo[93714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:43 devstack sudo[93715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:53:43 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:44 devstack sudo[93714]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-61ec9a01-a34a-45d0-bed0-dbcd0dc75616 tempest-ServerActionsTestOtherA-701184065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8af91ef0-9bea-4ce9-9708-6a09805de990" returned: 0 in 0.269s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-61ec9a01-a34a-45d0-bed0-dbcd0dc75616 tempest-ServerActionsTestOtherA-701184065 None] Lock "cinder-quobyte-8af91ef0-9bea-4ce9-9708-6a09805de990" released by "delete_volume" :: held 0.819s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:53:44 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b4bda26c-1a28-428f-8ef1-466fbce556e3 tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.305s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:44 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-b4bda26c-1a28-428f-8ef1-466fbce556e3 tempest-GroupSnapshotsTest-696014180 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:53:44 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-b4bda26c-1a28-428f-8ef1-466fbce556e3 tempest-GroupSnapshotsTest-696014180 None] Delete group completed successfully.
Sep 04 15:53:44 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-61ec9a01-a34a-45d0-bed0-dbcd0dc75616 tempest-ServerActionsTestOtherA-701184065 None] Created reservations ['7f3faa37-7c9c-4efe-92c5-6c12b1192b4f', '9799b34f-4526-4316-a70e-065efb5a1242', 'be59add0-f6d8-4675-a744-c9a2b90da088', '8cff5f1f-863a-479b-b296-d080fa6099ad'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:53:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-61ec9a01-a34a-45d0-bed0-dbcd0dc75616 tempest-ServerActionsTestOtherA-701184065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-61ec9a01-a34a-45d0-bed0-dbcd0dc75616 tempest-ServerActionsTestOtherA-701184065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-61ec9a01-a34a-45d0-bed0-dbcd0dc75616 tempest-ServerActionsTestOtherA-701184065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:53:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-61ec9a01-a34a-45d0-bed0-dbcd0dc75616 tempest-ServerActionsTestOtherA-701184065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:53:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-61ec9a01-a34a-45d0-bed0-dbcd0dc75616 tempest-ServerActionsTestOtherA-701184065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-61ec9a01-a34a-45d0-bed0-dbcd0dc75616 tempest-ServerActionsTestOtherA-701184065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:44 devstack sudo[93720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:53:44 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:44 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:44 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-b4ddd55c-d741-4add-96fd-f739810e7cb4 tempest-GroupsTest-963774338 None] Update group completed successfully.
Sep 04 15:53:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-61ec9a01-a34a-45d0-bed0-dbcd0dc75616 tempest-ServerActionsTestOtherA-701184065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.283s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:44 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-61ec9a01-a34a-45d0-bed0-dbcd0dc75616 tempest-ServerActionsTestOtherA-701184065 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:53:44 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-61ec9a01-a34a-45d0-bed0-dbcd0dc75616 tempest-ServerActionsTestOtherA-701184065 None] Deleted volume successfully.
Sep 04 15:53:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-61ec9a01-a34a-45d0-bed0-dbcd0dc75616 tempest-ServerActionsTestOtherA-701184065 None] Lock "cinder-8af91ef0-9bea-4ce9-9708-6a09805de990-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:53:44 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-52bef1eb-2e58-480f-bd1f-473bd1697a37 tempest-GroupSnapshotsTest-696014180 None] group_snapshot 0a2548fb-6aeb-4a94-af45-5d61c79099df: deleting
Sep 04 15:53:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52bef1eb-2e58-480f-bd1f-473bd1697a37 tempest-GroupSnapshotsTest-696014180 None] group_snapshot 0a2548fb-6aeb-4a94-af45-5d61c79099df: deleting {{(pid=87504) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 04 15:53:45 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-52bef1eb-2e58-480f-bd1f-473bd1697a37 tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "cinder-quobyte-d56d828f-5e6c-4094-a5f6-ec269289ed1c" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:53:45 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-52bef1eb-2e58-480f-bd1f-473bd1697a37 tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-d56d828f-5e6c-4094-a5f6-ec269289ed1c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:53:45 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-52bef1eb-2e58-480f-bd1f-473bd1697a37 tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "cinder-quobyte-512ab7bc-351c-40d2-8b06-fbc3c7957f31" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:53:45 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-52bef1eb-2e58-480f-bd1f-473bd1697a37 tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-512ab7bc-351c-40d2-8b06-fbc3c7957f31" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:53:45 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-52bef1eb-2e58-480f-bd1f-473bd1697a37 tempest-GroupSnapshotsTest-696014180 None] Deleting offline snapshot 512ab7bc-351c-40d2-8b06-fbc3c7957f31 of volume d56d828f-5e6c-4094-a5f6-ec269289ed1c {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 15:53:45 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-52bef1eb-2e58-480f-bd1f-473bd1697a37 tempest-GroupSnapshotsTest-696014180 None] snapshot_file for this snap is: volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.512ab7bc-351c-40d2-8b06-fbc3c7957f31 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 15:53:45 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9827f0-ac83-4ad0-bd59-00fa943b18cb]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:53:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-52bef1eb-2e58-480f-bd1f-473bd1697a37 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.512ab7bc-351c-40d2-8b06-fbc3c7957f31 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:45 devstack sudo[93723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.512ab7bc-351c-40d2-8b06-fbc3c7957f31
Sep 04 15:53:45 devstack sudo[93723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:45 devstack sudo[93723]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-52bef1eb-2e58-480f-bd1f-473bd1697a37 tempest-GroupSnapshotsTest-696014180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.512ab7bc-351c-40d2-8b06-fbc3c7957f31" returned: 0 in 0.376s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:45 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-52bef1eb-2e58-480f-bd1f-473bd1697a37 tempest-GroupSnapshotsTest-696014180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:53:45 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e7ed27-0a41-4e96-a4d1-913a516725c4]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:53:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-52bef1eb-2e58-480f-bd1f-473bd1697a37 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:45 devstack sudo[93728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c
Sep 04 15:53:45 devstack sudo[93728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:46 devstack sudo[93728]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-52bef1eb-2e58-480f-bd1f-473bd1697a37 tempest-GroupSnapshotsTest-696014180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c" returned: 0 in 0.859s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-52bef1eb-2e58-480f-bd1f-473bd1697a37 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.512ab7bc-351c-40d2-8b06-fbc3c7957f31 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:46 devstack sudo[93752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.512ab7bc-351c-40d2-8b06-fbc3c7957f31
Sep 04 15:53:46 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:46 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-afa2fdc5-8246-4b5d-824e-246d538c0f0d tempest-GroupsTest-963774338 None] Update group completed successfully.
Sep 04 15:53:46 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-52bef1eb-2e58-480f-bd1f-473bd1697a37 tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.512ab7bc-351c-40d2-8b06-fbc3c7957f31" returned: 0 in 0.553s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-52bef1eb-2e58-480f-bd1f-473bd1697a37 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.512ab7bc-351c-40d2-8b06-fbc3c7957f31 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:46 devstack sudo[93763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.512ab7bc-351c-40d2-8b06-fbc3c7957f31
Sep 04 15:53:46 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:47 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-52bef1eb-2e58-480f-bd1f-473bd1697a37 tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c.512ab7bc-351c-40d2-8b06-fbc3c7957f31" returned: 0 in 0.297s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-52bef1eb-2e58-480f-bd1f-473bd1697a37 tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-512ab7bc-351c-40d2-8b06-fbc3c7957f31" released by "_delete_snapshot" :: held 2.203s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:53:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-52bef1eb-2e58-480f-bd1f-473bd1697a37 tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-d56d828f-5e6c-4094-a5f6-ec269289ed1c" released by "delete_snapshot" :: held 2.229s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:53:47 devstack cinder-volume[87504]: WARNING cinder.quota [None req-52bef1eb-2e58-480f-bd1f-473bd1697a37 tempest-GroupSnapshotsTest-696014180 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-396033693 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-396033693, it is now deprecated. Please use the default quota class for default quota.
Sep 04 15:53:47 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-52bef1eb-2e58-480f-bd1f-473bd1697a37 tempest-GroupSnapshotsTest-696014180 None] Created reservations ['ebad688c-2e88-476a-873f-e8fb6d3214bd', '409cbaa7-1dcc-4c62-a82f-3dbc910fd34b', '4b634f17-2f54-439b-974a-17df4617f17d', '4974b55c-686f-4ac8-8a6c-de73ce0c525b'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:53:47 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-52bef1eb-2e58-480f-bd1f-473bd1697a37 tempest-GroupSnapshotsTest-696014180 None] group_snapshot 0a2548fb-6aeb-4a94-af45-5d61c79099df: deleted successfully
Sep 04 15:53:48 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] Acquiring lock "cinder-quobyte-69654cd0-c55f-4c36-aed7-52d7191a4514" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:53:48 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:53:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:53:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:53:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:48 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] Lock "cinder-quobyte-69654cd0-c55f-4c36-aed7-52d7191a4514" acquired by "delete_volume" :: waited 0.060s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:53:48 devstack sudo[93770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:53:48 devstack sudo[93770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:48 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c4c837-a02e-45ab-a0d2-31c416b5af32]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:53:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-69654cd0-c55f-4c36-aed7-52d7191a4514 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:48 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c95f7469-e9c3-4030-8e1a-b1dcb30c5be0 tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "cinder-quobyte-d56d828f-5e6c-4094-a5f6-ec269289ed1c" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:53:48 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c95f7469-e9c3-4030-8e1a-b1dcb30c5be0 tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-d56d828f-5e6c-4094-a5f6-ec269289ed1c" acquired by "delete_volume" :: waited 0.031s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:53:48 devstack sudo[93772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-69654cd0-c55f-4c36-aed7-52d7191a4514
Sep 04 15:53:48 devstack sudo[93772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fb6ef7-a38b-44ae-a72f-abaf929e36af]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c95f7469-e9c3-4030-8e1a-b1dcb30c5be0 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:49 devstack sudo[93770]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.526s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager._thread_info {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread count: 28 {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread info: [<_MainThread(MainThread, started 131673838448768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131673724603200)>, <Thread(Thread-3 (stat_writer), started daemon 131673723495936)>, <Thread(Rabbit-heartbeat, started daemon 131673723764800)>, <Thread(Thread-5 (_runner), started daemon 131673722269632)>, <Thread(Thread-7 (_runner), started daemon 131673722322112)>, <Thread(fd_logger, started daemon 131673722585024)>, <Thread(privsep_reader, started daemon 131673721593984)>, <Thread(tpool_thread_0, started daemon 131673714706112)>, <Thread(tpool_thread_1, started daemon 131673706313408)>, <Thread(tpool_thread_2, started daemon 131673697920704)>, <Thread(tpool_thread_3, started daemon 131673689528000)>, <Thread(tpool_thread_4, started daemon 131673681135296)>, <Thread(tpool_thread_5, started daemon 131673672726208)>, <Thread(tpool_thread_6, started daemon 131673664317120)>, <Thread(tpool_thread_7, started daemon 131673655908032)>, <Thread(tpool_thread_8, started daemon 131673647498944)>, <Thread(tpool_thread_9, started daemon 131673639089856)>, <Thread(tpool_thread_10, started daemon 131673630680768)>, <Thread(tpool_thread_11, started daemon 131673622271680)>, <Thread(tpool_thread_12, started daemon 131673613862592)>, <Thread(tpool_thread_13, started daemon 131673605453504)>, <Thread(tpool_thread_14, started daemon 131673597044416)>, <Thread(tpool_thread_15, started daemon 131673588635328)>, <Thread(tpool_thread_16, started daemon 131673580226240)>, <Thread(tpool_thread_17, started daemon 131673571817152)>, <Thread(tpool_thread_18, started daemon 131673563408064)>, <Thread(tpool_thread_19, started daemon 131673554998976)>] {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 15:53:49 devstack sudo[93775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c
Sep 04 15:53:49 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:49 devstack sudo[93772]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-69654cd0-c55f-4c36-aed7-52d7191a4514" returned: 0 in 0.575s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-69654cd0-c55f-4c36-aed7-52d7191a4514 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:49 devstack sudo[93782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-69654cd0-c55f-4c36-aed7-52d7191a4514
Sep 04 15:53:49 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:49 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c95f7469-e9c3-4030-8e1a-b1dcb30c5be0 tempest-GroupSnapshotsTest-696014180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c" returned: 0 in 0.679s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c95f7469-e9c3-4030-8e1a-b1dcb30c5be0 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:49 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-69654cd0-c55f-4c36-aed7-52d7191a4514" returned: 0 in 0.391s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:49 devstack sudo[93789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c
Sep 04 15:53:49 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] Lock "cinder-quobyte-69654cd0-c55f-4c36-aed7-52d7191a4514" released by "delete_volume" :: held 1.047s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] Acquiring lock "cinder-quobyte-d4275fe9-567a-4ae6-b23c-7883587d87e4" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] Lock "cinder-quobyte-d4275fe9-567a-4ae6-b23c-7883587d87e4" acquired by "delete_volume" :: waited 0.022s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6180125-ef94-4be0-9b9d-f75402f7ab17]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d4275fe9-567a-4ae6-b23c-7883587d87e4 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Flow 'volume_create_manager' (ab2a83df-7c64-414e-8543-36cd145de4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b121e3-1605-4717-bc3f-e51a713464b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b121e3-1605-4717-bc3f-e51a713464b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-508133810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ba3c32-15ab-448f-a0cc-de265fbc8890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa21d4d006974393944a07e61261e034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:50Z,use_quota=True,user_id='88ebbd4a86c24b1489254f27ae660243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b93a5bf-f682-4bb8-9343-7786f48ab72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b93a5bf-f682-4bb8-9343-7786f48ab72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7393e17-aa68-407f-a0db-a7087a2fbf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7393e17-aa68-407f-a0db-a7087a2fbf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18ba3c32-15ab-448f-a0cc-de265fbc8890', 'volume_name': 'volume-18ba3c32-15ab-448f-a0cc-de265fbc8890', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:49 devstack sudo[93791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d4275fe9-567a-4ae6-b23c-7883587d87e4
Sep 04 15:53:49 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda687c4-69a5-4703-9e6e-0542ba577651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda687c4-69a5-4703-9e6e-0542ba577651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a050ede-c539-4aa0-bc15-61e9df9cee40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:49 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Volume 18ba3c32-15ab-448f-a0cc-de265fbc8890: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18ba3c32-15ab-448f-a0cc-de265fbc8890', 'volume_size': 1}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-508133810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ba3c32-15ab-448f-a0cc-de265fbc8890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa21d4d006974393944a07e61261e034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:50Z,use_quota=True,user_id='88ebbd4a86c24b1489254f27ae660243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Creating volume 18ba3c32-15ab-448f-a0cc-de265fbc8890 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:53:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:53:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:53:50 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:53:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-18ba3c32-15ab-448f-a0cc-de265fbc8890 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:50 devstack sudo[93794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-18ba3c32-15ab-448f-a0cc-de265fbc8890 1073741824
Sep 04 15:53:50 devstack sudo[93794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:50 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c95f7469-e9c3-4030-8e1a-b1dcb30c5be0 tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d56d828f-5e6c-4094-a5f6-ec269289ed1c" returned: 0 in 0.380s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c95f7469-e9c3-4030-8e1a-b1dcb30c5be0 tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-d56d828f-5e6c-4094-a5f6-ec269289ed1c" released by "delete_volume" :: held 1.189s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:53:50 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-c95f7469-e9c3-4030-8e1a-b1dcb30c5be0 tempest-GroupSnapshotsTest-696014180 None] Created reservations ['1d473e39-a02a-47ba-9fda-2d639985a11c'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:53:50 devstack cinder-volume[87504]: WARNING cinder.db.api [None req-c95f7469-e9c3-4030-8e1a-b1dcb30c5be0 tempest-GroupSnapshotsTest-696014180 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-396033693']
Sep 04 15:53:50 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-c95f7469-e9c3-4030-8e1a-b1dcb30c5be0 tempest-GroupSnapshotsTest-696014180 None] Created reservations ['e9fba7de-9c3a-4a12-bfd8-869e5ef6b981', 'b7a0ffc7-7cf3-4d6b-8a63-e7cf58342f0b', 'a5fd92a1-7da9-47ee-8f9e-d524c9bf4dfa', '1bff3d2a-8f7c-4ece-8a9b-6d467e470529'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:53:50 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d4275fe9-567a-4ae6-b23c-7883587d87e4" returned: 0 in 0.634s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d4275fe9-567a-4ae6-b23c-7883587d87e4 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:50 devstack sudo[93803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d4275fe9-567a-4ae6-b23c-7883587d87e4
Sep 04 15:53:50 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c95f7469-e9c3-4030-8e1a-b1dcb30c5be0 tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c95f7469-e9c3-4030-8e1a-b1dcb30c5be0 tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c95f7469-e9c3-4030-8e1a-b1dcb30c5be0 tempest-GroupSnapshotsTest-696014180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:53:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c95f7469-e9c3-4030-8e1a-b1dcb30c5be0 tempest-GroupSnapshotsTest-696014180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:53:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c95f7469-e9c3-4030-8e1a-b1dcb30c5be0 tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c95f7469-e9c3-4030-8e1a-b1dcb30c5be0 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:50 devstack sudo[93806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:53:50 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:50 devstack sudo[93794]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-18ba3c32-15ab-448f-a0cc-de265fbc8890 1073741824" returned: 0 in 0.717s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-18ba3c32-15ab-448f-a0cc-de265fbc8890 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:50 devstack sudo[93809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-18ba3c32-15ab-448f-a0cc-de265fbc8890
Sep 04 15:53:50 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:50 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:50 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c95f7469-e9c3-4030-8e1a-b1dcb30c5be0 tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.297s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d4275fe9-567a-4ae6-b23c-7883587d87e4" returned: 0 in 0.391s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:50 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-c95f7469-e9c3-4030-8e1a-b1dcb30c5be0 tempest-GroupSnapshotsTest-696014180 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:53:50 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-c95f7469-e9c3-4030-8e1a-b1dcb30c5be0 tempest-GroupSnapshotsTest-696014180 None] Delete group completed successfully.
Sep 04 15:53:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] Lock "cinder-quobyte-d4275fe9-567a-4ae6-b23c-7883587d87e4" released by "delete_volume" :: held 1.106s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:53:50 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] Created reservations ['95d102fa-9afd-49ae-a8fc-95d4d2f90c6c'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:53:50 devstack cinder-volume[87504]: WARNING cinder.quota [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-96612191 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-96612191, it is now deprecated. Please use the default quota class for default quota.
Sep 04 15:53:50 devstack cinder-volume[87504]: WARNING cinder.quota [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-96612191 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-96612191, it is now deprecated. Please use the default quota class for default quota.
Sep 04 15:53:51 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] Created reservations ['d9c76629-3c48-4c89-b81f-6463b5ec9261', '49c955e4-c1c3-4378-87d0-e8e3d6ab794c', 'ada3590c-2f04-43e8-8b8f-d3fbfc7ccdd6', 'd523296f-7027-4ffd-a9c3-fef756d183b8'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:53:51 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-18ba3c32-15ab-448f-a0cc-de265fbc8890" returned: 0 in 0.347s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:51 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:53:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:51 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a050ede-c539-4aa0-bc15-61e9df9cee40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18ba3c32-15ab-448f-a0cc-de265fbc8890', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:51 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (191f5e10-4f64-473f-bcee-fc382ef91a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:51 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Volume volume-18ba3c32-15ab-448f-a0cc-de265fbc8890 (18ba3c32-15ab-448f-a0cc-de265fbc8890): created successfully
Sep 04 15:53:51 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (191f5e10-4f64-473f-bcee-fc382ef91a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:51 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Flow 'volume_create_manager' (ab2a83df-7c64-414e-8543-36cd145de4f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:53:51 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] Created reservations ['c3d24cf2-025b-4ac9-9339-ed192ecbb018', '52e66f23-fe0e-42d0-82b3-ba3147129bfe', '4cd5357e-3d17-4e3a-b135-40e606a41619', 'a54cd3ff-a204-4eb9-a2ac-0bf84a4e76bf'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:53:51 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-32b3afe9-e906-423f-8170-aee62bbc5161 tempest-AttachVolumeNegativeTest-866639513 None] Created volume successfully.
Sep 04 15:53:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:51 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:53:51 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:53:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:51 devstack sudo[93813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:53:51 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:51 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.321s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:51 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:53:51 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-d9ca7d22-d4f0-49a2-965d-a9c5064c0e3b tempest-GroupsTest-963774338 None] Delete group completed successfully.
Sep 04 15:53:52 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-3e303a90-358f-4bc5-9eb8-39256a7560b8 tempest-GroupSnapshotsTest-696014180 None] Group tempest-GroupSnapshotsTest-Group-218047072: creating
Sep 04 15:53:52 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-3e303a90-358f-4bc5-9eb8-39256a7560b8 tempest-GroupSnapshotsTest-696014180 None] Group tempest-GroupSnapshotsTest-Group-218047072: created successfully
Sep 04 15:53:52 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-3e303a90-358f-4bc5-9eb8-39256a7560b8 tempest-GroupSnapshotsTest-696014180 None] Create group completed successfully.
Sep 04 15:53:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-2a55b3b7-9231-4706-a6f1-364ba3a81e0c req-263cd613-0ed7-485e-91dd-d2902be78fa1 tempest-AttachVolumeNegativeTest-866639513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-2a55b3b7-9231-4706-a6f1-364ba3a81e0c req-263cd613-0ed7-485e-91dd-d2902be78fa1 tempest-AttachVolumeNegativeTest-866639513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-2a55b3b7-9231-4706-a6f1-364ba3a81e0c req-263cd613-0ed7-485e-91dd-d2902be78fa1 tempest-AttachVolumeNegativeTest-866639513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-2a55b3b7-9231-4706-a6f1-364ba3a81e0c req-263cd613-0ed7-485e-91dd-d2902be78fa1 tempest-AttachVolumeNegativeTest-866639513 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236', 'name': 'volume-18ba3c32-15ab-448f-a0cc-de265fbc8890', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a32f133-a53f-4530-a3d8-9b995149f224', 'enforce_multipath': True} {{(pid=87504) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 15:53:53 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-2a55b3b7-9231-4706-a6f1-364ba3a81e0c req-263cd613-0ed7-485e-91dd-d2902be78fa1 tempest-AttachVolumeNegativeTest-866639513 None] attachment_update completed successfully.
Sep 04 15:53:54 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:53:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Flow 'volume_create_manager' (e411dae5-f7e0-4e5f-8e8c-cc8d3f127014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:53:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881bdbfb-4639-4b42-972b-9e1a47e95cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881bdbfb-4639-4b42-972b-9e1a47e95cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1016339227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=499c46d2-429a-431f-bd94-f6c4d8b100d2,host='devstack@QuobyteHD#QuobyteHD',id=c27df4eb-9a1d-4a51-a89b-866c76fd03b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724e2b57c44a420f801eee3ae9e4f189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:54Z,use_quota=True,user_id='e8a90017b307406c83691843dccb3631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61f084e6-13c9-47cf-b3b1-7ae225a0efdd),volume_type_id=61f084e6-13c9-47cf-b3b1-7ae225a0efdd)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8046e5f5-41ed-4e20-bc3a-e038703b5874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8046e5f5-41ed-4e20-bc3a-e038703b5874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c42053e2-f01f-4e61-97f2-8925581f4892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c42053e2-f01f-4e61-97f2-8925581f4892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c27df4eb-9a1d-4a51-a89b-866c76fd03b2', 'volume_name': 'volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b552ac5-ed2c-4282-815d-e76691039f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b552ac5-ed2c-4282-815d-e76691039f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee372166-2744-4826-b4e3-df83af741ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:54 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Volume c27df4eb-9a1d-4a51-a89b-866c76fd03b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2', 'volume_size': 1}
Sep 04 15:53:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=499c46d2-429a-431f-bd94-f6c4d8b100d2,created_at=2026-09-04T13:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1016339227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=499c46d2-429a-431f-bd94-f6c4d8b100d2,host='devstack@QuobyteHD#QuobyteHD',id=c27df4eb-9a1d-4a51-a89b-866c76fd03b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724e2b57c44a420f801eee3ae9e4f189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:54Z,use_quota=True,user_id='e8a90017b307406c83691843dccb3631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61f084e6-13c9-47cf-b3b1-7ae225a0efdd),volume_type_id=61f084e6-13c9-47cf-b3b1-7ae225a0efdd)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:53:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Creating volume c27df4eb-9a1d-4a51-a89b-866c76fd03b2 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:53:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:53:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:53:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:53:54 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:53:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:54 devstack sudo[94214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2 1073741824
Sep 04 15:53:54 devstack sudo[94214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:55 devstack sudo[94214]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2 1073741824" returned: 0 in 0.608s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:55 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=126,cinder:UPDATE=124,cinder:INSERT=28,cinder:DELETE=6 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:53:55 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:UPDATE=122,cinder:SELECT=123,cinder:INSERT=26,cinder:DELETE=4 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:53:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:55 devstack sudo[94220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2
Sep 04 15:53:55 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:55 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2" returned: 0 in 0.391s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:53:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee372166-2744-4826-b4e3-df83af741ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8f95b9-1331-41b9-bdd9-40b6636f934b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:55 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Volume volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2 (c27df4eb-9a1d-4a51-a89b-866c76fd03b2): created successfully
Sep 04 15:53:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8f95b9-1331-41b9-bdd9-40b6636f934b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Flow 'volume_create_manager' (e411dae5-f7e0-4e5f-8e8c-cc8d3f127014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:53:55 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-6f173f7f-d8bd-43f9-93d5-d91dbea4be8f tempest-GroupSnapshotsTest-696014180 None] Created volume successfully.
Sep 04 15:53:57 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:53:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Flow 'volume_create_manager' (9beb3ba1-a85f-4d8b-a94f-9bc79e0fb257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:53:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84df993-9c77-4ac3-a57b-c338c72f62a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84df993-9c77-4ac3-a57b-c338c72f62a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1695623493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=499c46d2-429a-431f-bd94-f6c4d8b100d2,host='devstack@QuobyteHD#QuobyteHD',id=be5e25b3-08db-4fa0-8d2d-85e7ebf99181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724e2b57c44a420f801eee3ae9e4f189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:58Z,use_quota=True,user_id='e8a90017b307406c83691843dccb3631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61f084e6-13c9-47cf-b3b1-7ae225a0efdd),volume_type_id=61f084e6-13c9-47cf-b3b1-7ae225a0efdd)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f071fa-c99c-4c99-87a8-5a4a9005d8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f071fa-c99c-4c99-87a8-5a4a9005d8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96d85d8-898e-4a3c-adb0-ab5e6a3a5dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96d85d8-898e-4a3c-adb0-ab5e6a3a5dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be5e25b3-08db-4fa0-8d2d-85e7ebf99181', 'volume_name': 'volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb72ae1-39ef-4884-ba6c-56c299a2a1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb72ae1-39ef-4884-ba6c-56c299a2a1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9dfa3b-1070-40b3-9888-40bc9ed34f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:57 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Volume be5e25b3-08db-4fa0-8d2d-85e7ebf99181: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181', 'volume_size': 1}
Sep 04 15:53:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:57 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=499c46d2-429a-431f-bd94-f6c4d8b100d2,created_at=2026-09-04T13:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1695623493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=499c46d2-429a-431f-bd94-f6c4d8b100d2,host='devstack@QuobyteHD#QuobyteHD',id=be5e25b3-08db-4fa0-8d2d-85e7ebf99181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724e2b57c44a420f801eee3ae9e4f189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:58Z,use_quota=True,user_id='e8a90017b307406c83691843dccb3631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61f084e6-13c9-47cf-b3b1-7ae225a0efdd),volume_type_id=61f084e6-13c9-47cf-b3b1-7ae225a0efdd)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:53:57 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Creating volume be5e25b3-08db-4fa0-8d2d-85e7ebf99181 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:53:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:53:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:53:57 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:53:57 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:53:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:57 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:53:57 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:53:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:58 devstack sudo[94260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181 1073741824
Sep 04 15:53:58 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:58 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181 1073741824" returned: 0 in 0.683s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:53:58 devstack sudo[94266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181
Sep 04 15:53:58 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:53:58 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root
Sep 04 15:53:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181" returned: 0 in 0.293s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:53:58 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:53:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:53:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9dfa3b-1070-40b3-9888-40bc9ed34f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af772b6e-eefe-47b3-ba5b-95f56b2ae555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:53:59 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Volume volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181 (be5e25b3-08db-4fa0-8d2d-85e7ebf99181): created successfully
Sep 04 15:53:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af772b6e-eefe-47b3-ba5b-95f56b2ae555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:53:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Flow 'volume_create_manager' (9beb3ba1-a85f-4d8b-a94f-9bc79e0fb257) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:53:59 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-469531e9-d009-4560-b1b9-33c33369120a tempest-GroupSnapshotsTest-696014180 None] Created volume successfully.
Sep 04 15:54:00 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e95c51f9-7294-4e2c-86ec-5c3f1d10f364 tempest-GroupSnapshotsTest-696014180 None] Update group completed successfully.
Sep 04 15:54:01 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-48197ff0-990d-4b9b-94ef-f53b2da44eb7 tempest-GroupSnapshotsTest-696014180 None] Update group completed successfully.
Sep 04 15:54:02 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e3a9c9ec-7f0c-4f54-88b1-57d3f824c861 tempest-GroupSnapshotsTest-696014180 None] Update group completed successfully.
Sep 04 15:54:04 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-703f4864-8f5e-48df-9000-865f261ec3c1 tempest-GroupSnapshotsTest-696014180 None] Update group completed successfully.
Sep 04 15:54:05 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] GroupSnapshot c5b1cc01-1afd-4a8a-9085-60fca273c5c3: creating.
Sep 04 15:54:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] Group snapshot c5b1cc01-1afd-4a8a-9085-60fca273c5c3: creating. {{(pid=87504) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 04 15:54:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:54:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:54:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] Creating offline snapshot bcc99afb-8f77-4894-8e53-d5fc7903b670 of volume be5e25b3-08db-4fa0-8d2d-85e7ebf99181 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:54:05 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[82392770-fe28-41d5-b1b2-0bcf1e469f19]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:06 devstack sudo[94290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181
Sep 04 15:54:06 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:06 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181" returned: 0 in 0.477s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.bcc99afb-8f77-4894-8e53-d5fc7903b670 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:06 devstack sudo[94295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.bcc99afb-8f77-4894-8e53-d5fc7903b670 1G
Sep 04 15:54:06 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:07 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.bcc99afb-8f77-4894-8e53-d5fc7903b670 1G" returned: 0 in 0.596s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.bcc99afb-8f77-4894-8e53-d5fc7903b670 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:07 devstack sudo[94301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.bcc99afb-8f77-4894-8e53-d5fc7903b670
Sep 04 15:54:07 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:07 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.bcc99afb-8f77-4894-8e53-d5fc7903b670" returned: 0 in 0.349s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:07 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.bcc99afb-8f77-4894-8e53-d5fc7903b670 is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 15:54:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.bcc99afb-8f77-4894-8e53-d5fc7903b670 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:07 devstack sudo[94307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.bcc99afb-8f77-4894-8e53-d5fc7903b670
Sep 04 15:54:07 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:07 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.bcc99afb-8f77-4894-8e53-d5fc7903b670" returned: 0 in 0.306s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:07 devstack sudo[94310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.info
Sep 04 15:54:07 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:08 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.info" returned: 0 in 0.321s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:08 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 15:54:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:08 devstack sudo[94313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.info
Sep 04 15:54:08 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:08 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.info" returned: 0 in 0.370s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.594s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:54:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:54:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:54:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] Creating offline snapshot f0e4eb5b-e6b0-464f-bb7c-64dd58d36538 of volume c27df4eb-9a1d-4a51-a89b-866c76fd03b2 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:54:08 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c344679-d528-4e7d-b81d-3a9973525044]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:08 devstack sudo[94338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2
Sep 04 15:54:08 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:09 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2" returned: 0 in 0.692s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.f0e4eb5b-e6b0-464f-bb7c-64dd58d36538 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:09 devstack sudo[94360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.f0e4eb5b-e6b0-464f-bb7c-64dd58d36538 1G
Sep 04 15:54:09 devstack sudo[94360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:10 devstack sudo[94360]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.f0e4eb5b-e6b0-464f-bb7c-64dd58d36538 1G" returned: 0 in 0.975s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.f0e4eb5b-e6b0-464f-bb7c-64dd58d36538 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:10 devstack sudo[94369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.f0e4eb5b-e6b0-464f-bb7c-64dd58d36538
Sep 04 15:54:10 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:10 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.f0e4eb5b-e6b0-464f-bb7c-64dd58d36538" returned: 0 in 0.579s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:10 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.f0e4eb5b-e6b0-464f-bb7c-64dd58d36538 is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 15:54:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.f0e4eb5b-e6b0-464f-bb7c-64dd58d36538 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:11 devstack sudo[94375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.f0e4eb5b-e6b0-464f-bb7c-64dd58d36538
Sep 04 15:54:11 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:11 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.f0e4eb5b-e6b0-464f-bb7c-64dd58d36538" returned: 0 in 0.474s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:11 devstack sudo[94378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.info
Sep 04 15:54:11 devstack sudo[94378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:11 devstack sudo[94378]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.info" returned: 0 in 0.427s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:11 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 15:54:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:11 devstack sudo[94382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.info
Sep 04 15:54:11 devstack sudo[94382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:12 devstack sudo[94382]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.info" returned: 0 in 0.626s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.071s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:54:12 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-6f0afe11-b139-4788-a78d-afe0ce6b79dc tempest-GroupSnapshotsTest-696014180 None] group_snapshot c5b1cc01-1afd-4a8a-9085-60fca273c5c3: created successfully
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Flow 'volume_create_manager' (55aaf287-f04e-435a-b115-8e56216d0c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4379129-cb6b-463e-8190-32fd380a7eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4379129-cb6b-463e-8190-32fd380a7eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-354114671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebffe5cd-7119-4fcb-a579-866179123e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22b3999e1d3e45c594a3e01c281ef82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:13Z,use_quota=True,user_id='45dfdba715ff4ffca9a8e0b937d0661c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d7ef93-61d7-4e2a-8b01-845527c58d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d7ef93-61d7-4e2a-8b01-845527c58d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d299c7-96be-43e9-992d-6d81075498f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d299c7-96be-43e9-992d-6d81075498f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebffe5cd-7119-4fcb-a579-866179123e73', 'volume_name': 'volume-ebffe5cd-7119-4fcb-a579-866179123e73', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a767172-b95c-4783-8d60-9958b6d7bb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a767172-b95c-4783-8d60-9958b6d7bb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c80268-3313-46dd-ba28-a2d0eeded98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:54:13 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Volume ebffe5cd-7119-4fcb-a579-866179123e73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebffe5cd-7119-4fcb-a579-866179123e73', 'volume_size': 1}
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-354114671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebffe5cd-7119-4fcb-a579-866179123e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22b3999e1d3e45c594a3e01c281ef82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:13Z,use_quota=True,user_id='45dfdba715ff4ffca9a8e0b937d0661c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Creating volume ebffe5cd-7119-4fcb-a579-866179123e73 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:54:13 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:13 devstack sudo[94410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73 1073741824
Sep 04 15:54:13 devstack sudo[94410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:13 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] group_snapshot c5b1cc01-1afd-4a8a-9085-60fca273c5c3: deleting
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] group_snapshot c5b1cc01-1afd-4a8a-9085-60fca273c5c3: deleting {{(pid=87504) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "cinder-quobyte-be5e25b3-08db-4fa0-8d2d-85e7ebf99181" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-be5e25b3-08db-4fa0-8d2d-85e7ebf99181" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "cinder-quobyte-bcc99afb-8f77-4894-8e53-d5fc7903b670" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-bcc99afb-8f77-4894-8e53-d5fc7903b670" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Deleting offline snapshot bcc99afb-8f77-4894-8e53-d5fc7903b670 of volume be5e25b3-08db-4fa0-8d2d-85e7ebf99181 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 15:54:14 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] snapshot_file for this snap is: volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.bcc99afb-8f77-4894-8e53-d5fc7903b670 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 15:54:14 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[670858e7-e5cd-41cf-81f8-207b061bbb44]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.bcc99afb-8f77-4894-8e53-d5fc7903b670 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:14 devstack sudo[94413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.bcc99afb-8f77-4894-8e53-d5fc7903b670
Sep 04 15:54:14 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:14 devstack sudo[94410]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73 1073741824" returned: 0 in 1.061s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:14 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.bcc99afb-8f77-4894-8e53-d5fc7903b670" returned: 0 in 0.781s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:14 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:54:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:14 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[828c63e2-f730-4a76-b65b-a1b283b9185b]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:14 devstack sudo[94421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73
Sep 04 15:54:14 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:15 devstack sudo[94422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181
Sep 04 15:54:15 devstack sudo[94422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:15 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73" returned: 0 in 0.570s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:15 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:54:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:54:15 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c80268-3313-46dd-ba28-a2d0eeded98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebffe5cd-7119-4fcb-a579-866179123e73', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:54:15 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d95f1b-9220-42d4-a3f5-a52b1ae0d36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:54:15 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Volume volume-ebffe5cd-7119-4fcb-a579-866179123e73 (ebffe5cd-7119-4fcb-a579-866179123e73): created successfully
Sep 04 15:54:15 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d95f1b-9220-42d4-a3f5-a52b1ae0d36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:54:15 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Flow 'volume_create_manager' (55aaf287-f04e-435a-b115-8e56216d0c57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:54:15 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-3598fa93-362c-4765-8dc4-dac91107e75e tempest-SnapshotsActionsTest-1895414665 None] Created volume successfully.
Sep 04 15:54:15 devstack sudo[94422]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181" returned: 0 in 0.878s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.bcc99afb-8f77-4894-8e53-d5fc7903b670 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:15 devstack sudo[94430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.bcc99afb-8f77-4894-8e53-d5fc7903b670
Sep 04 15:54:15 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-460fc92d-6ba1-430f-b4c6-2fa665bb20e5 tempest-SnapshotsActionsTest-1895414665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:54:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-460fc92d-6ba1-430f-b4c6-2fa665bb20e5 tempest-SnapshotsActionsTest-1895414665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:54:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-460fc92d-6ba1-430f-b4c6-2fa665bb20e5 tempest-SnapshotsActionsTest-1895414665 None] Creating offline snapshot 5eb40825-fa32-4d17-8436-1c38ea1e176c of volume ebffe5cd-7119-4fcb-a579-866179123e73 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:54:16 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dccea4e-6ab6-425c-bd74-8888c1e6b655]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-460fc92d-6ba1-430f-b4c6-2fa665bb20e5 tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:16 devstack sudo[94435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73
Sep 04 15:54:16 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:16 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.bcc99afb-8f77-4894-8e53-d5fc7903b670" returned: 0 in 0.600s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.bcc99afb-8f77-4894-8e53-d5fc7903b670 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:16 devstack sudo[94438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.bcc99afb-8f77-4894-8e53-d5fc7903b670
Sep 04 15:54:16 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:16 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-460fc92d-6ba1-430f-b4c6-2fa665bb20e5 tempest-SnapshotsActionsTest-1895414665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73" returned: 0 in 0.556s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-460fc92d-6ba1-430f-b4c6-2fa665bb20e5 tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:16 devstack sudo[94443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c 1G
Sep 04 15:54:16 devstack sudo[94443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:16 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181.bcc99afb-8f77-4894-8e53-d5fc7903b670" returned: 0 in 0.484s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-bcc99afb-8f77-4894-8e53-d5fc7903b670" released by "_delete_snapshot" :: held 2.932s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-be5e25b3-08db-4fa0-8d2d-85e7ebf99181" released by "delete_snapshot" :: held 2.981s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "cinder-quobyte-c27df4eb-9a1d-4a51-a89b-866c76fd03b2" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-c27df4eb-9a1d-4a51-a89b-866c76fd03b2" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "cinder-quobyte-f0e4eb5b-e6b0-464f-bb7c-64dd58d36538" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-f0e4eb5b-e6b0-464f-bb7c-64dd58d36538" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Deleting offline snapshot f0e4eb5b-e6b0-464f-bb7c-64dd58d36538 of volume c27df4eb-9a1d-4a51-a89b-866c76fd03b2 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 15:54:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] snapshot_file for this snap is: volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.f0e4eb5b-e6b0-464f-bb7c-64dd58d36538 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 15:54:17 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[386a548f-2171-4c98-a3cd-5d6c57f615e9]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.f0e4eb5b-e6b0-464f-bb7c-64dd58d36538 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:17 devstack sudo[94448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.f0e4eb5b-e6b0-464f-bb7c-64dd58d36538
Sep 04 15:54:17 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:17 devstack sudo[94443]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-460fc92d-6ba1-430f-b4c6-2fa665bb20e5 tempest-SnapshotsActionsTest-1895414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c 1G" returned: 0 in 0.699s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-460fc92d-6ba1-430f-b4c6-2fa665bb20e5 tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebffe5cd-7119-4fcb-a579-866179123e73 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:17 devstack sudo[94452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebffe5cd-7119-4fcb-a579-866179123e73 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c
Sep 04 15:54:17 devstack sudo[94452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:17 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.f0e4eb5b-e6b0-464f-bb7c-64dd58d36538" returned: 0 in 0.762s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:54:17 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[125ee672-44dc-41de-8d95-2365461f4905]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:17 devstack sudo[94452]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-460fc92d-6ba1-430f-b4c6-2fa665bb20e5 tempest-SnapshotsActionsTest-1895414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebffe5cd-7119-4fcb-a579-866179123e73 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c" returned: 0 in 0.529s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:17 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-460fc92d-6ba1-430f-b4c6-2fa665bb20e5 tempest-SnapshotsActionsTest-1895414665 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c is being set with open permissions: ugo+rw
Sep 04 15:54:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-460fc92d-6ba1-430f-b4c6-2fa665bb20e5 tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:17 devstack sudo[94461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c
Sep 04 15:54:17 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:17 devstack sudo[94460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2
Sep 04 15:54:18 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:18 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-460fc92d-6ba1-430f-b4c6-2fa665bb20e5 tempest-SnapshotsActionsTest-1895414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c" returned: 0 in 0.407s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-460fc92d-6ba1-430f-b4c6-2fa665bb20e5 tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:18 devstack sudo[94474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.info
Sep 04 15:54:18 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:18 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2" returned: 0 in 0.590s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.f0e4eb5b-e6b0-464f-bb7c-64dd58d36538 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:18 devstack sudo[94476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.f0e4eb5b-e6b0-464f-bb7c-64dd58d36538
Sep 04 15:54:18 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:18 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-460fc92d-6ba1-430f-b4c6-2fa665bb20e5 tempest-SnapshotsActionsTest-1895414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.info" returned: 0 in 0.385s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:18 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-460fc92d-6ba1-430f-b4c6-2fa665bb20e5 tempest-SnapshotsActionsTest-1895414665 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.info is being set with open permissions: ugo+rw
Sep 04 15:54:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-460fc92d-6ba1-430f-b4c6-2fa665bb20e5 tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:18 devstack sudo[94483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.info
Sep 04 15:54:18 devstack sudo[94483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:18 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.f0e4eb5b-e6b0-464f-bb7c-64dd58d36538" returned: 0 in 0.389s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.f0e4eb5b-e6b0-464f-bb7c-64dd58d36538 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:18 devstack sudo[94485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.f0e4eb5b-e6b0-464f-bb7c-64dd58d36538
Sep 04 15:54:18 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:19 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2.f0e4eb5b-e6b0-464f-bb7c-64dd58d36538" returned: 0 in 0.277s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-f0e4eb5b-e6b0-464f-bb7c-64dd58d36538" released by "_delete_snapshot" :: held 2.177s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-c27df4eb-9a1d-4a51-a89b-866c76fd03b2" released by "delete_snapshot" :: held 2.217s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:19 devstack sudo[94483]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-460fc92d-6ba1-430f-b4c6-2fa665bb20e5 tempest-SnapshotsActionsTest-1895414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.info" returned: 0 in 0.397s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-460fc92d-6ba1-430f-b4c6-2fa665bb20e5 tempest-SnapshotsActionsTest-1895414665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.134s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:54:19 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-460fc92d-6ba1-430f-b4c6-2fa665bb20e5 tempest-SnapshotsActionsTest-1895414665 None] Create snapshot completed successfully
Sep 04 15:54:19 devstack cinder-volume[87504]: WARNING cinder.quota [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-878772621 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-878772621, it is now deprecated. Please use the default quota class for default quota.
Sep 04 15:54:19 devstack cinder-volume[87504]: WARNING cinder.quota [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-878772621 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-878772621, it is now deprecated. Please use the default quota class for default quota.
Sep 04 15:54:19 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Created reservations ['0c88ed0f-209d-4163-81d4-3bb560afec71', '682437c9-c88e-4d03-9db9-6eab01d13030', '4d9adbd7-53c3-4390-a99b-52b543767e16', 'c8fef561-7994-494f-a183-69a5bf1d4daf'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:54:19 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] Created reservations ['b7650157-55b4-4d7d-96fe-e746e7c1abd3', '4277c858-009e-425e-b369-9c62d51c1229', '25c5bb02-9abf-49d9-9e85-621d8169a3fb', '691dafd5-0c8d-4e6c-8f6e-69494c6de636'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:54:19 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-ff8531c4-adb9-4b1a-9c2d-5ff12f10bc41 tempest-GroupSnapshotsTest-696014180 None] group_snapshot c5b1cc01-1afd-4a8a-9085-60fca273c5c3: deleted successfully
Sep 04 15:54:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "cinder-quobyte-be5e25b3-08db-4fa0-8d2d-85e7ebf99181" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-be5e25b3-08db-4fa0-8d2d-85e7ebf99181" acquired by "delete_volume" :: waited 0.025s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:20 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba5bf11-27fa-40bb-bf59-75b0485ea508]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:20 devstack sudo[94490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181
Sep 04 15:54:20 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:20 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181" returned: 0 in 0.488s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:20 devstack sudo[94499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181
Sep 04 15:54:20 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c546f4da-eecf-46ee-8196-d9f65eeecd9f tempest-SnapshotsActionsTest-1895414665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:54:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c546f4da-eecf-46ee-8196-d9f65eeecd9f tempest-SnapshotsActionsTest-1895414665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:54:21 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-be5e25b3-08db-4fa0-8d2d-85e7ebf99181" returned: 0 in 0.416s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-c546f4da-eecf-46ee-8196-d9f65eeecd9f tempest-SnapshotsActionsTest-1895414665 None] Creating offline snapshot b55ac96a-5f7c-4cf2-8858-41361f326cb3 of volume ebffe5cd-7119-4fcb-a579-866179123e73 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:54:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-be5e25b3-08db-4fa0-8d2d-85e7ebf99181" released by "delete_volume" :: held 1.071s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "cinder-quobyte-c27df4eb-9a1d-4a51-a89b-866c76fd03b2" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:21 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a96d53-d1d4-4b2e-920f-bcccd2e68677]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c546f4da-eecf-46ee-8196-d9f65eeecd9f tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-c27df4eb-9a1d-4a51-a89b-866c76fd03b2" acquired by "delete_volume" :: waited 0.036s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:21 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c899ded-017a-4e47-a85a-c2db088ddad6]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:21 devstack sudo[94502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c
Sep 04 15:54:21 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:21 devstack sudo[94503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2
Sep 04 15:54:21 devstack sudo[94503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:21 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c546f4da-eecf-46ee-8196-d9f65eeecd9f tempest-SnapshotsActionsTest-1895414665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c" returned: 0 in 0.532s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-c546f4da-eecf-46ee-8196-d9f65eeecd9f tempest-SnapshotsActionsTest-1895414665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebffe5cd-7119-4fcb-a579-866179123e73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:54:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c546f4da-eecf-46ee-8196-d9f65eeecd9f tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b55ac96a-5f7c-4cf2-8858-41361f326cb3 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:21 devstack sudo[94512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b55ac96a-5f7c-4cf2-8858-41361f326cb3 1G
Sep 04 15:54:21 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:22 devstack sudo[94503]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2" returned: 0 in 0.673s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:22 devstack sudo[94517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2
Sep 04 15:54:22 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:22 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c27df4eb-9a1d-4a51-a89b-866c76fd03b2" returned: 0 in 0.361s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-c27df4eb-9a1d-4a51-a89b-866c76fd03b2" released by "delete_volume" :: held 1.123s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:22 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] Created reservations ['b009145e-ceed-45c8-b184-34dd657ec9ac'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:54:22 devstack cinder-volume[87504]: WARNING cinder.quota [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-878772621 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-878772621, it is now deprecated. Please use the default quota class for default quota.
Sep 04 15:54:22 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] Created reservations ['64ee15a6-2462-4a11-bcaa-50ff1ad8ffa9', '291e9c29-275e-4447-8375-5f7544abf4e9', 'db07a782-439f-4f84-8110-1442f7d05e1a', 'c7facde2-ebfa-40d9-b5fb-b577403329e8'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:54:22 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c546f4da-eecf-46ee-8196-d9f65eeecd9f tempest-SnapshotsActionsTest-1895414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b55ac96a-5f7c-4cf2-8858-41361f326cb3 1G" returned: 0 in 0.792s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c546f4da-eecf-46ee-8196-d9f65eeecd9f tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b55ac96a-5f7c-4cf2-8858-41361f326cb3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:22 devstack sudo[94524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b55ac96a-5f7c-4cf2-8858-41361f326cb3
Sep 04 15:54:22 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:22 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] Created reservations ['46201182-6fe2-4264-95d4-6cdc6c42cb74', 'c219b1e7-d91a-42b2-be92-9053da4ed5b4', '34259f40-f1fe-416c-bd8f-b3a22a6e1213', '235e4e9b-4edd-4cb1-b7ac-21330d4f2fef'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:54:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:54:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:54:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:54:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:54:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:54:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:23 devstack sudo[94550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:54:23 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:23 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.308s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:23 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:54:23 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-80140dcf-2392-49cf-b640-d33f53ffdfac tempest-GroupSnapshotsTest-696014180 None] Delete group completed successfully.
Sep 04 15:54:23 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c546f4da-eecf-46ee-8196-d9f65eeecd9f tempest-SnapshotsActionsTest-1895414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b55ac96a-5f7c-4cf2-8858-41361f326cb3" returned: 0 in 0.855s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:23 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-c546f4da-eecf-46ee-8196-d9f65eeecd9f tempest-SnapshotsActionsTest-1895414665 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b55ac96a-5f7c-4cf2-8858-41361f326cb3 is being set with open permissions: ugo+rw
Sep 04 15:54:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c546f4da-eecf-46ee-8196-d9f65eeecd9f tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b55ac96a-5f7c-4cf2-8858-41361f326cb3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:23 devstack sudo[94560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b55ac96a-5f7c-4cf2-8858-41361f326cb3
Sep 04 15:54:23 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:23 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c546f4da-eecf-46ee-8196-d9f65eeecd9f tempest-SnapshotsActionsTest-1895414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b55ac96a-5f7c-4cf2-8858-41361f326cb3" returned: 0 in 0.289s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c546f4da-eecf-46ee-8196-d9f65eeecd9f tempest-SnapshotsActionsTest-1895414665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.642s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:54:23 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-c546f4da-eecf-46ee-8196-d9f65eeecd9f tempest-SnapshotsActionsTest-1895414665 None] Create snapshot completed successfully
Sep 04 15:54:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-16e4791a-6853-47c9-81da-b8c66048fe14 tempest-SnapshotsActionsTest-1042333865 None] Acquiring lock "cinder-b55ac96a-5f7c-4cf2-8858-41361f326cb3-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-16e4791a-6853-47c9-81da-b8c66048fe14 tempest-SnapshotsActionsTest-1042333865 None] Lock "cinder-b55ac96a-5f7c-4cf2-8858-41361f326cb3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-16e4791a-6853-47c9-81da-b8c66048fe14 tempest-SnapshotsActionsTest-1042333865 None] Acquiring lock "cinder-quobyte-ebffe5cd-7119-4fcb-a579-866179123e73" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-16e4791a-6853-47c9-81da-b8c66048fe14 tempest-SnapshotsActionsTest-1042333865 None] Lock "cinder-quobyte-ebffe5cd-7119-4fcb-a579-866179123e73" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-16e4791a-6853-47c9-81da-b8c66048fe14 tempest-SnapshotsActionsTest-1042333865 None] Acquiring lock "cinder-quobyte-b55ac96a-5f7c-4cf2-8858-41361f326cb3" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-16e4791a-6853-47c9-81da-b8c66048fe14 tempest-SnapshotsActionsTest-1042333865 None] Lock "cinder-quobyte-b55ac96a-5f7c-4cf2-8858-41361f326cb3" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:24 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-16e4791a-6853-47c9-81da-b8c66048fe14 tempest-SnapshotsActionsTest-1042333865 None] Deleting offline snapshot b55ac96a-5f7c-4cf2-8858-41361f326cb3 of volume ebffe5cd-7119-4fcb-a579-866179123e73 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 15:54:24 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-16e4791a-6853-47c9-81da-b8c66048fe14 tempest-SnapshotsActionsTest-1042333865 None] snapshot_file for this snap is: volume-ebffe5cd-7119-4fcb-a579-866179123e73.b55ac96a-5f7c-4cf2-8858-41361f326cb3 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 15:54:24 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b39e94e-8d64-43f7-bc07-624757a2120e]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-16e4791a-6853-47c9-81da-b8c66048fe14 tempest-SnapshotsActionsTest-1042333865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b55ac96a-5f7c-4cf2-8858-41361f326cb3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:24 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-09d9fb81-9ebf-4c00-b376-90f51570ca45 tempest-GroupSnapshotsTest-696014180 None] Group tempest-GroupSnapshotsTest-Group-1891323404: creating
Sep 04 15:54:24 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-09d9fb81-9ebf-4c00-b376-90f51570ca45 tempest-GroupSnapshotsTest-696014180 None] Group tempest-GroupSnapshotsTest-Group-1891323404: created successfully
Sep 04 15:54:24 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-09d9fb81-9ebf-4c00-b376-90f51570ca45 tempest-GroupSnapshotsTest-696014180 None] Create group completed successfully.
Sep 04 15:54:24 devstack sudo[94577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b55ac96a-5f7c-4cf2-8858-41361f326cb3
Sep 04 15:54:24 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:25 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-16e4791a-6853-47c9-81da-b8c66048fe14 tempest-SnapshotsActionsTest-1042333865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b55ac96a-5f7c-4cf2-8858-41361f326cb3" returned: 0 in 0.428s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:25 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-16e4791a-6853-47c9-81da-b8c66048fe14 tempest-SnapshotsActionsTest-1042333865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebffe5cd-7119-4fcb-a579-866179123e73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:54:25 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3583e6d4-4ede-4e13-88ad-faf95b0f098e]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-16e4791a-6853-47c9-81da-b8c66048fe14 tempest-SnapshotsActionsTest-1042333865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:25 devstack sudo[94582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c
Sep 04 15:54:25 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:25 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-16e4791a-6853-47c9-81da-b8c66048fe14 tempest-SnapshotsActionsTest-1042333865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c" returned: 0 in 0.415s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:25 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-16e4791a-6853-47c9-81da-b8c66048fe14 tempest-SnapshotsActionsTest-1042333865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebffe5cd-7119-4fcb-a579-866179123e73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:54:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-16e4791a-6853-47c9-81da-b8c66048fe14 tempest-SnapshotsActionsTest-1042333865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b55ac96a-5f7c-4cf2-8858-41361f326cb3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:25 devstack sudo[94588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b55ac96a-5f7c-4cf2-8858-41361f326cb3
Sep 04 15:54:25 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:26 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-16e4791a-6853-47c9-81da-b8c66048fe14 tempest-SnapshotsActionsTest-1042333865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b55ac96a-5f7c-4cf2-8858-41361f326cb3" returned: 0 in 0.644s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-16e4791a-6853-47c9-81da-b8c66048fe14 tempest-SnapshotsActionsTest-1042333865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b55ac96a-5f7c-4cf2-8858-41361f326cb3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:26 devstack sudo[94608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b55ac96a-5f7c-4cf2-8858-41361f326cb3
Sep 04 15:54:26 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:26 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-16e4791a-6853-47c9-81da-b8c66048fe14 tempest-SnapshotsActionsTest-1042333865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b55ac96a-5f7c-4cf2-8858-41361f326cb3" returned: 0 in 0.473s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:26 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-16e4791a-6853-47c9-81da-b8c66048fe14 tempest-SnapshotsActionsTest-1042333865 None] Lock "cinder-quobyte-b55ac96a-5f7c-4cf2-8858-41361f326cb3" released by "_delete_snapshot" :: held 2.153s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:26 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-16e4791a-6853-47c9-81da-b8c66048fe14 tempest-SnapshotsActionsTest-1042333865 None] Lock "cinder-quobyte-ebffe5cd-7119-4fcb-a579-866179123e73" released by "delete_snapshot" :: held 2.203s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:26 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-16e4791a-6853-47c9-81da-b8c66048fe14 tempest-SnapshotsActionsTest-1042333865 None] Created reservations ['70bf0407-0491-42b5-9bdc-c9f4544e4cf9', 'f14fcc79-1a79-45e4-ab82-af92476d4b97', '3a5507b3-1ebf-4ed8-a9fd-50339540b028', 'd54e25ac-4302-4e4c-b4ef-aeaddc6d27aa'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:54:27 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:54:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Flow 'volume_create_manager' (317f4ed3-0666-42d5-a33d-02bca7439100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:54:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e72f6e1-1cb3-4680-8a80-87089b7c7712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:54:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e72f6e1-1cb3-4680-8a80-87089b7c7712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-551720552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f4ba431a-9466-4099-b9b3-5d9840c6d149,host='devstack@QuobyteHD#QuobyteHD',id=750a1ba7-db2b-4666-8dfd-741d7fdb3853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724e2b57c44a420f801eee3ae9e4f189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:27Z,use_quota=True,user_id='e8a90017b307406c83691843dccb3631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(700a4350-6d42-4e04-859d-e5c94c45d1f8),volume_type_id=700a4350-6d42-4e04-859d-e5c94c45d1f8)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:54:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f66ce8-c351-48c8-b6ea-ae9129bfd732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:54:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f66ce8-c351-48c8-b6ea-ae9129bfd732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:54:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5539260b-13c3-4920-b845-2ac11ed8159b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:54:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5539260b-13c3-4920-b845-2ac11ed8159b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '750a1ba7-db2b-4666-8dfd-741d7fdb3853', 'volume_name': 'volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:54:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43601160-3276-461b-a619-079469a7e28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:54:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43601160-3276-461b-a619-079469a7e28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:54:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6acb383e-a5b9-435b-8034-1524d456487b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:54:27 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Volume 750a1ba7-db2b-4666-8dfd-741d7fdb3853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853', 'volume_size': 1}
Sep 04 15:54:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:54:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:54:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f4ba431a-9466-4099-b9b3-5d9840c6d149,created_at=2026-09-04T13:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-551720552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f4ba431a-9466-4099-b9b3-5d9840c6d149,host='devstack@QuobyteHD#QuobyteHD',id=750a1ba7-db2b-4666-8dfd-741d7fdb3853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724e2b57c44a420f801eee3ae9e4f189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:27Z,use_quota=True,user_id='e8a90017b307406c83691843dccb3631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(700a4350-6d42-4e04-859d-e5c94c45d1f8),volume_type_id=700a4350-6d42-4e04-859d-e5c94c45d1f8)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:54:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Creating volume 750a1ba7-db2b-4666-8dfd-741d7fdb3853 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:54:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:54:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:54:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:54:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:54:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:54:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:54:27 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:54:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:27 devstack sudo[94657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853 1073741824
Sep 04 15:54:27 devstack sudo[94657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:27 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-16e4791a-6853-47c9-81da-b8c66048fe14 tempest-SnapshotsActionsTest-1042333865 None] Delete snapshot completed successfully.
Sep 04 15:54:27 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-16e4791a-6853-47c9-81da-b8c66048fe14 tempest-SnapshotsActionsTest-1042333865 None] Lock "cinder-b55ac96a-5f7c-4cf2-8858-41361f326cb3-delete_snapshot" released by "delete_snapshot" :: held 2.690s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:27 devstack sudo[94657]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853 1073741824" returned: 0 in 0.614s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:27 devstack sudo[94669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853
Sep 04 15:54:27 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:28 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853" returned: 0 in 0.355s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:54:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:54:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6acb383e-a5b9-435b-8034-1524d456487b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:54:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (212748f0-7136-4600-9f5a-6ef303067c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:54:28 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Volume volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853 (750a1ba7-db2b-4666-8dfd-741d7fdb3853): created successfully
Sep 04 15:54:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (212748f0-7136-4600-9f5a-6ef303067c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:54:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Flow 'volume_create_manager' (317f4ed3-0666-42d5-a33d-02bca7439100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:54:28 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f7a8c875-5ee7-424c-9cff-9e1db62b4fca tempest-GroupSnapshotsTest-696014180 None] Created volume successfully.
Sep 04 15:54:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-56d34c18-b8d8-4c03-b51e-ae3c60c53d21 tempest-SnapshotsActionsTest-1895414665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:54:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-56d34c18-b8d8-4c03-b51e-ae3c60c53d21 tempest-SnapshotsActionsTest-1895414665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:54:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-56d34c18-b8d8-4c03-b51e-ae3c60c53d21 tempest-SnapshotsActionsTest-1895414665 None] Creating offline snapshot 333f4c1f-18b0-47d3-a397-232b50677acb of volume ebffe5cd-7119-4fcb-a579-866179123e73 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:54:28 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc41d7f3-5e14-4273-9b5b-2b131d77a788]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-56d34c18-b8d8-4c03-b51e-ae3c60c53d21 tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:28 devstack sudo[94674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c
Sep 04 15:54:28 devstack sudo[94674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:28 devstack sudo[94674]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-56d34c18-b8d8-4c03-b51e-ae3c60c53d21 tempest-SnapshotsActionsTest-1895414665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c" returned: 0 in 0.414s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-56d34c18-b8d8-4c03-b51e-ae3c60c53d21 tempest-SnapshotsActionsTest-1895414665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebffe5cd-7119-4fcb-a579-866179123e73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:54:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-56d34c18-b8d8-4c03-b51e-ae3c60c53d21 tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.333f4c1f-18b0-47d3-a397-232b50677acb 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:28 devstack sudo[94679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.333f4c1f-18b0-47d3-a397-232b50677acb 1G
Sep 04 15:54:28 devstack sudo[94679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:29 devstack sudo[94679]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-56d34c18-b8d8-4c03-b51e-ae3c60c53d21 tempest-SnapshotsActionsTest-1895414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.333f4c1f-18b0-47d3-a397-232b50677acb 1G" returned: 0 in 0.562s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-56d34c18-b8d8-4c03-b51e-ae3c60c53d21 tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.333f4c1f-18b0-47d3-a397-232b50677acb {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:29 devstack sudo[94685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.333f4c1f-18b0-47d3-a397-232b50677acb
Sep 04 15:54:29 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:29 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-56d34c18-b8d8-4c03-b51e-ae3c60c53d21 tempest-SnapshotsActionsTest-1895414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.333f4c1f-18b0-47d3-a397-232b50677acb" returned: 0 in 0.479s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:29 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-56d34c18-b8d8-4c03-b51e-ae3c60c53d21 tempest-SnapshotsActionsTest-1895414665 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.333f4c1f-18b0-47d3-a397-232b50677acb is being set with open permissions: ugo+rw
Sep 04 15:54:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-56d34c18-b8d8-4c03-b51e-ae3c60c53d21 tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.333f4c1f-18b0-47d3-a397-232b50677acb {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:30 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-85f14ec5-2bc6-462c-a383-115df443934e tempest-GroupSnapshotsTest-696014180 None] GroupSnapshot 165c5b04-9355-4261-bd63-17e8bb4b7a3c: creating.
Sep 04 15:54:30 devstack sudo[94692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.333f4c1f-18b0-47d3-a397-232b50677acb
Sep 04 15:54:30 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-85f14ec5-2bc6-462c-a383-115df443934e tempest-GroupSnapshotsTest-696014180 None] Group snapshot 165c5b04-9355-4261-bd63-17e8bb4b7a3c: creating. {{(pid=87504) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 04 15:54:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-85f14ec5-2bc6-462c-a383-115df443934e tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:54:30 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-56d34c18-b8d8-4c03-b51e-ae3c60c53d21 tempest-SnapshotsActionsTest-1895414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.333f4c1f-18b0-47d3-a397-232b50677acb" returned: 0 in 0.416s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-56d34c18-b8d8-4c03-b51e-ae3c60c53d21 tempest-SnapshotsActionsTest-1895414665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:54:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-85f14ec5-2bc6-462c-a383-115df443934e tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.375s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:54:30 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-85f14ec5-2bc6-462c-a383-115df443934e tempest-GroupSnapshotsTest-696014180 None] Creating offline snapshot 07df4b3a-be1d-4246-8595-9269e9df7ff5 of volume 750a1ba7-db2b-4666-8dfd-741d7fdb3853 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:54:30 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-56d34c18-b8d8-4c03-b51e-ae3c60c53d21 tempest-SnapshotsActionsTest-1895414665 None] Create snapshot completed successfully
Sep 04 15:54:30 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6b8735-2681-4101-a0d0-5fac0c5ff0f2]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-85f14ec5-2bc6-462c-a383-115df443934e tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:30 devstack sudo[94695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853
Sep 04 15:54:30 devstack sudo[94695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:31 devstack sudo[94695]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-85f14ec5-2bc6-462c-a383-115df443934e tempest-GroupSnapshotsTest-696014180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853" returned: 0 in 0.570s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-85f14ec5-2bc6-462c-a383-115df443934e tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.07df4b3a-be1d-4246-8595-9269e9df7ff5 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:31 devstack sudo[94705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.07df4b3a-be1d-4246-8595-9269e9df7ff5 1G
Sep 04 15:54:31 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:31 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-85f14ec5-2bc6-462c-a383-115df443934e tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.07df4b3a-be1d-4246-8595-9269e9df7ff5 1G" returned: 0 in 0.734s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-85f14ec5-2bc6-462c-a383-115df443934e tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.07df4b3a-be1d-4246-8595-9269e9df7ff5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:31 devstack sudo[94721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.07df4b3a-be1d-4246-8595-9269e9df7ff5
Sep 04 15:54:31 devstack sudo[94721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:32 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9ceec1f5-4456-4d7c-848f-d0cc88212a27 tempest-SnapshotsActionsTest-1042333865 None] Acquiring lock "cinder-333f4c1f-18b0-47d3-a397-232b50677acb-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:32 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9ceec1f5-4456-4d7c-848f-d0cc88212a27 tempest-SnapshotsActionsTest-1042333865 None] Lock "cinder-333f4c1f-18b0-47d3-a397-232b50677acb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:32 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9ceec1f5-4456-4d7c-848f-d0cc88212a27 tempest-SnapshotsActionsTest-1042333865 None] Acquiring lock "cinder-quobyte-ebffe5cd-7119-4fcb-a579-866179123e73" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:32 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9ceec1f5-4456-4d7c-848f-d0cc88212a27 tempest-SnapshotsActionsTest-1042333865 None] Lock "cinder-quobyte-ebffe5cd-7119-4fcb-a579-866179123e73" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:32 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9ceec1f5-4456-4d7c-848f-d0cc88212a27 tempest-SnapshotsActionsTest-1042333865 None] Acquiring lock "cinder-quobyte-333f4c1f-18b0-47d3-a397-232b50677acb" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:32 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9ceec1f5-4456-4d7c-848f-d0cc88212a27 tempest-SnapshotsActionsTest-1042333865 None] Lock "cinder-quobyte-333f4c1f-18b0-47d3-a397-232b50677acb" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:32 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-9ceec1f5-4456-4d7c-848f-d0cc88212a27 tempest-SnapshotsActionsTest-1042333865 None] Deleting offline snapshot 333f4c1f-18b0-47d3-a397-232b50677acb of volume ebffe5cd-7119-4fcb-a579-866179123e73 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 15:54:32 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-9ceec1f5-4456-4d7c-848f-d0cc88212a27 tempest-SnapshotsActionsTest-1042333865 None] snapshot_file for this snap is: volume-ebffe5cd-7119-4fcb-a579-866179123e73.333f4c1f-18b0-47d3-a397-232b50677acb {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 15:54:32 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d5f846-72e8-4095-8708-a7139a90ffa9]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9ceec1f5-4456-4d7c-848f-d0cc88212a27 tempest-SnapshotsActionsTest-1042333865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.333f4c1f-18b0-47d3-a397-232b50677acb {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:32 devstack sudo[94726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.333f4c1f-18b0-47d3-a397-232b50677acb
Sep 04 15:54:32 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:32 devstack sudo[94721]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-85f14ec5-2bc6-462c-a383-115df443934e tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.07df4b3a-be1d-4246-8595-9269e9df7ff5" returned: 0 in 0.494s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:32 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-85f14ec5-2bc6-462c-a383-115df443934e tempest-GroupSnapshotsTest-696014180 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.07df4b3a-be1d-4246-8595-9269e9df7ff5 is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 15:54:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-85f14ec5-2bc6-462c-a383-115df443934e tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.07df4b3a-be1d-4246-8595-9269e9df7ff5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:32 devstack sudo[94735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.07df4b3a-be1d-4246-8595-9269e9df7ff5
Sep 04 15:54:32 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:32 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9ceec1f5-4456-4d7c-848f-d0cc88212a27 tempest-SnapshotsActionsTest-1042333865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.333f4c1f-18b0-47d3-a397-232b50677acb" returned: 0 in 0.484s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:32 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-9ceec1f5-4456-4d7c-848f-d0cc88212a27 tempest-SnapshotsActionsTest-1042333865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebffe5cd-7119-4fcb-a579-866179123e73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:54:32 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0771229-b089-4194-9299-ddb8b08cf7ef]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9ceec1f5-4456-4d7c-848f-d0cc88212a27 tempest-SnapshotsActionsTest-1042333865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:32 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-85f14ec5-2bc6-462c-a383-115df443934e tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.07df4b3a-be1d-4246-8595-9269e9df7ff5" returned: 0 in 0.426s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-85f14ec5-2bc6-462c-a383-115df443934e tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:32 devstack sudo[94741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c
Sep 04 15:54:32 devstack sudo[94741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:32 devstack sudo[94744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.info
Sep 04 15:54:32 devstack sudo[94744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:33 devstack sudo[94744]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-85f14ec5-2bc6-462c-a383-115df443934e tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.info" returned: 0 in 0.362s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:33 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-85f14ec5-2bc6-462c-a383-115df443934e tempest-GroupSnapshotsTest-696014180 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 15:54:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-85f14ec5-2bc6-462c-a383-115df443934e tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:33 devstack sudo[94741]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9ceec1f5-4456-4d7c-848f-d0cc88212a27 tempest-SnapshotsActionsTest-1042333865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c" returned: 0 in 0.560s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:33 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-9ceec1f5-4456-4d7c-848f-d0cc88212a27 tempest-SnapshotsActionsTest-1042333865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebffe5cd-7119-4fcb-a579-866179123e73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:54:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9ceec1f5-4456-4d7c-848f-d0cc88212a27 tempest-SnapshotsActionsTest-1042333865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.333f4c1f-18b0-47d3-a397-232b50677acb {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:33 devstack sudo[94751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.info
Sep 04 15:54:33 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:33 devstack sudo[94752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.333f4c1f-18b0-47d3-a397-232b50677acb
Sep 04 15:54:33 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:33 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-85f14ec5-2bc6-462c-a383-115df443934e tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.info" returned: 0 in 0.245s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-85f14ec5-2bc6-462c-a383-115df443934e tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.066s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:54:33 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-85f14ec5-2bc6-462c-a383-115df443934e tempest-GroupSnapshotsTest-696014180 None] group_snapshot 165c5b04-9355-4261-bd63-17e8bb4b7a3c: created successfully
Sep 04 15:54:33 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9ceec1f5-4456-4d7c-848f-d0cc88212a27 tempest-SnapshotsActionsTest-1042333865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.333f4c1f-18b0-47d3-a397-232b50677acb" returned: 0 in 0.421s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9ceec1f5-4456-4d7c-848f-d0cc88212a27 tempest-SnapshotsActionsTest-1042333865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.333f4c1f-18b0-47d3-a397-232b50677acb {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:33 devstack sudo[94759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.333f4c1f-18b0-47d3-a397-232b50677acb
Sep 04 15:54:33 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:33 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9ceec1f5-4456-4d7c-848f-d0cc88212a27 tempest-SnapshotsActionsTest-1042333865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.333f4c1f-18b0-47d3-a397-232b50677acb" returned: 0 in 0.261s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:34 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9ceec1f5-4456-4d7c-848f-d0cc88212a27 tempest-SnapshotsActionsTest-1042333865 None] Lock "cinder-quobyte-333f4c1f-18b0-47d3-a397-232b50677acb" released by "_delete_snapshot" :: held 1.881s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:34 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9ceec1f5-4456-4d7c-848f-d0cc88212a27 tempest-SnapshotsActionsTest-1042333865 None] Lock "cinder-quobyte-ebffe5cd-7119-4fcb-a579-866179123e73" released by "delete_snapshot" :: held 1.928s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:34 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-9ceec1f5-4456-4d7c-848f-d0cc88212a27 tempest-SnapshotsActionsTest-1042333865 None] Created reservations ['60307f7b-636c-46cd-9e43-dc4ba3f54022', 'bcbc8c60-32da-48ac-98f9-c9020fac1d92', '064bda4f-f1c3-417f-be04-987882a95b67', '224f9e29-671f-46b8-9387-c5f6d32b9881'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:54:34 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-9ceec1f5-4456-4d7c-848f-d0cc88212a27 tempest-SnapshotsActionsTest-1042333865 None] Delete snapshot completed successfully.
Sep 04 15:54:34 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9ceec1f5-4456-4d7c-848f-d0cc88212a27 tempest-SnapshotsActionsTest-1042333865 None] Lock "cinder-333f4c1f-18b0-47d3-a397-232b50677acb-delete_snapshot" released by "delete_snapshot" :: held 2.102s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-375fd2e6-9815-403b-97cb-78b19d352b83 tempest-SnapshotsActionsTest-1895414665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:54:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-375fd2e6-9815-403b-97cb-78b19d352b83 tempest-SnapshotsActionsTest-1895414665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:54:34 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-8dd0f8e8-0264-400f-9e4f-1c94b33f7136 tempest-GroupSnapshotsTest-696014180 None] group_snapshot 165c5b04-9355-4261-bd63-17e8bb4b7a3c: deleting
Sep 04 15:54:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-375fd2e6-9815-403b-97cb-78b19d352b83 tempest-SnapshotsActionsTest-1895414665 None] Creating offline snapshot b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c of volume ebffe5cd-7119-4fcb-a579-866179123e73 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:54:34 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed35d6e-3d72-4164-bd41-d912dd16098f]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-375fd2e6-9815-403b-97cb-78b19d352b83 tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-8dd0f8e8-0264-400f-9e4f-1c94b33f7136 tempest-GroupSnapshotsTest-696014180 None] group_snapshot 165c5b04-9355-4261-bd63-17e8bb4b7a3c: deleting {{(pid=87504) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 04 15:54:34 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8dd0f8e8-0264-400f-9e4f-1c94b33f7136 tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "cinder-quobyte-750a1ba7-db2b-4666-8dfd-741d7fdb3853" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:34 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8dd0f8e8-0264-400f-9e4f-1c94b33f7136 tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-750a1ba7-db2b-4666-8dfd-741d7fdb3853" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:34 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8dd0f8e8-0264-400f-9e4f-1c94b33f7136 tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "cinder-quobyte-07df4b3a-be1d-4246-8595-9269e9df7ff5" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:34 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8dd0f8e8-0264-400f-9e4f-1c94b33f7136 tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-07df4b3a-be1d-4246-8595-9269e9df7ff5" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-8dd0f8e8-0264-400f-9e4f-1c94b33f7136 tempest-GroupSnapshotsTest-696014180 None] Deleting offline snapshot 07df4b3a-be1d-4246-8595-9269e9df7ff5 of volume 750a1ba7-db2b-4666-8dfd-741d7fdb3853 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 15:54:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-8dd0f8e8-0264-400f-9e4f-1c94b33f7136 tempest-GroupSnapshotsTest-696014180 None] snapshot_file for this snap is: volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.07df4b3a-be1d-4246-8595-9269e9df7ff5 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 15:54:34 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b99d3e-c09a-4e64-ba6e-be49f586b78e]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8dd0f8e8-0264-400f-9e4f-1c94b33f7136 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.07df4b3a-be1d-4246-8595-9269e9df7ff5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:34 devstack sudo[94763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c
Sep 04 15:54:34 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:34 devstack sudo[94764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.07df4b3a-be1d-4246-8595-9269e9df7ff5
Sep 04 15:54:34 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:35 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-375fd2e6-9815-403b-97cb-78b19d352b83 tempest-SnapshotsActionsTest-1895414665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c" returned: 0 in 0.473s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:35 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-375fd2e6-9815-403b-97cb-78b19d352b83 tempest-SnapshotsActionsTest-1895414665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebffe5cd-7119-4fcb-a579-866179123e73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:54:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-375fd2e6-9815-403b-97cb-78b19d352b83 tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:35 devstack sudo[94773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c 1G
Sep 04 15:54:35 devstack sudo[94773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:35 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8dd0f8e8-0264-400f-9e4f-1c94b33f7136 tempest-GroupSnapshotsTest-696014180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.07df4b3a-be1d-4246-8595-9269e9df7ff5" returned: 0 in 0.375s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:35 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-8dd0f8e8-0264-400f-9e4f-1c94b33f7136 tempest-GroupSnapshotsTest-696014180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:54:35 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[03069626-5e98-4371-8f8f-16669fb57d10]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8dd0f8e8-0264-400f-9e4f-1c94b33f7136 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:35 devstack sudo[94775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853
Sep 04 15:54:35 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:35 devstack sudo[94773]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-375fd2e6-9815-403b-97cb-78b19d352b83 tempest-SnapshotsActionsTest-1895414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c 1G" returned: 0 in 0.425s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-375fd2e6-9815-403b-97cb-78b19d352b83 tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:35 devstack sudo[94782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c
Sep 04 15:54:35 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:35 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8dd0f8e8-0264-400f-9e4f-1c94b33f7136 tempest-GroupSnapshotsTest-696014180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853" returned: 0 in 0.402s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8dd0f8e8-0264-400f-9e4f-1c94b33f7136 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.07df4b3a-be1d-4246-8595-9269e9df7ff5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:35 devstack sudo[94786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.07df4b3a-be1d-4246-8595-9269e9df7ff5
Sep 04 15:54:35 devstack sudo[94786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:35 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-375fd2e6-9815-403b-97cb-78b19d352b83 tempest-SnapshotsActionsTest-1895414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c" returned: 0 in 0.390s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:35 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-375fd2e6-9815-403b-97cb-78b19d352b83 tempest-SnapshotsActionsTest-1895414665 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c is being set with open permissions: ugo+rw
Sep 04 15:54:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-375fd2e6-9815-403b-97cb-78b19d352b83 tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:35 devstack sudo[94795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c
Sep 04 15:54:35 devstack sudo[94795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:36 devstack sudo[94786]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8dd0f8e8-0264-400f-9e4f-1c94b33f7136 tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.07df4b3a-be1d-4246-8595-9269e9df7ff5" returned: 0 in 0.430s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8dd0f8e8-0264-400f-9e4f-1c94b33f7136 tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.07df4b3a-be1d-4246-8595-9269e9df7ff5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:36 devstack sudo[94797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.07df4b3a-be1d-4246-8595-9269e9df7ff5
Sep 04 15:54:36 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:36 devstack sudo[94795]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-375fd2e6-9815-403b-97cb-78b19d352b83 tempest-SnapshotsActionsTest-1895414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c" returned: 0 in 0.411s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:36 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-375fd2e6-9815-403b-97cb-78b19d352b83 tempest-SnapshotsActionsTest-1895414665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.862s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:54:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8dd0f8e8-0264-400f-9e4f-1c94b33f7136 tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853.07df4b3a-be1d-4246-8595-9269e9df7ff5" returned: 0 in 0.390s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:36 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8dd0f8e8-0264-400f-9e4f-1c94b33f7136 tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-07df4b3a-be1d-4246-8595-9269e9df7ff5" released by "_delete_snapshot" :: held 1.740s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:36 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8dd0f8e8-0264-400f-9e4f-1c94b33f7136 tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-750a1ba7-db2b-4666-8dfd-741d7fdb3853" released by "delete_snapshot" :: held 1.778s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:36 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-375fd2e6-9815-403b-97cb-78b19d352b83 tempest-SnapshotsActionsTest-1895414665 None] Create snapshot completed successfully
Sep 04 15:54:36 devstack cinder-volume[87504]: WARNING cinder.quota [None req-8dd0f8e8-0264-400f-9e4f-1c94b33f7136 tempest-GroupSnapshotsTest-696014180 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-69721352 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-69721352, it is now deprecated. Please use the default quota class for default quota.
Sep 04 15:54:36 devstack cinder-volume[87504]: WARNING cinder.quota [None req-8dd0f8e8-0264-400f-9e4f-1c94b33f7136 tempest-GroupSnapshotsTest-696014180 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-69721352 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-69721352, it is now deprecated. Please use the default quota class for default quota.
Sep 04 15:54:36 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-8dd0f8e8-0264-400f-9e4f-1c94b33f7136 tempest-GroupSnapshotsTest-696014180 None] Created reservations ['9bb8cd78-0320-413c-a6b6-f1dec12928be', '0e17d50f-d0fb-446c-a00f-4ecf924f1672', 'f36df795-b098-4bf7-b5d8-abd7165499fb', '62df906f-6aec-43a0-8813-046f5f7088da'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:54:36 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-8dd0f8e8-0264-400f-9e4f-1c94b33f7136 tempest-GroupSnapshotsTest-696014180 None] group_snapshot 165c5b04-9355-4261-bd63-17e8bb4b7a3c: deleted successfully
Sep 04 15:54:37 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e3898e74-95a7-4e35-aae7-d0bd72c7b2d5 tempest-SnapshotsActionsTest-1042333865 None] Acquiring lock "cinder-b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:37 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e3898e74-95a7-4e35-aae7-d0bd72c7b2d5 tempest-SnapshotsActionsTest-1042333865 None] Lock "cinder-b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:37 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e3898e74-95a7-4e35-aae7-d0bd72c7b2d5 tempest-SnapshotsActionsTest-1042333865 None] Acquiring lock "cinder-quobyte-ebffe5cd-7119-4fcb-a579-866179123e73" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:37 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e3898e74-95a7-4e35-aae7-d0bd72c7b2d5 tempest-SnapshotsActionsTest-1042333865 None] Lock "cinder-quobyte-ebffe5cd-7119-4fcb-a579-866179123e73" acquired by "delete_snapshot" :: waited 0.065s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:37 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e3898e74-95a7-4e35-aae7-d0bd72c7b2d5 tempest-SnapshotsActionsTest-1042333865 None] Acquiring lock "cinder-quobyte-b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:37 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e3898e74-95a7-4e35-aae7-d0bd72c7b2d5 tempest-SnapshotsActionsTest-1042333865 None] Lock "cinder-quobyte-b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:37 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-e3898e74-95a7-4e35-aae7-d0bd72c7b2d5 tempest-SnapshotsActionsTest-1042333865 None] Deleting offline snapshot b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c of volume ebffe5cd-7119-4fcb-a579-866179123e73 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 15:54:37 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-e3898e74-95a7-4e35-aae7-d0bd72c7b2d5 tempest-SnapshotsActionsTest-1042333865 None] snapshot_file for this snap is: volume-ebffe5cd-7119-4fcb-a579-866179123e73.b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 15:54:37 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abd8ba6-9f82-457b-a9b1-c51cec5afe00]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e3898e74-95a7-4e35-aae7-d0bd72c7b2d5 tempest-SnapshotsActionsTest-1042333865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:37 devstack sudo[94826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c
Sep 04 15:54:37 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:37 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e5d183d4-0631-419c-b0f3-627adb85feea tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "cinder-quobyte-750a1ba7-db2b-4666-8dfd-741d7fdb3853" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:37 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e5d183d4-0631-419c-b0f3-627adb85feea tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-750a1ba7-db2b-4666-8dfd-741d7fdb3853" acquired by "delete_volume" :: waited 0.038s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:37 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9e87a1-6ca3-4372-913e-3f30488089f1]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e5d183d4-0631-419c-b0f3-627adb85feea tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:38 devstack sudo[94828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853
Sep 04 15:54:38 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:38 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e3898e74-95a7-4e35-aae7-d0bd72c7b2d5 tempest-SnapshotsActionsTest-1042333865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c" returned: 0 in 0.710s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-e3898e74-95a7-4e35-aae7-d0bd72c7b2d5 tempest-SnapshotsActionsTest-1042333865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebffe5cd-7119-4fcb-a579-866179123e73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:54:38 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[be533061-82af-49b5-8c99-d69fffb53277]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e3898e74-95a7-4e35-aae7-d0bd72c7b2d5 tempest-SnapshotsActionsTest-1042333865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:38 devstack sudo[94833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c
Sep 04 15:54:38 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:38 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e5d183d4-0631-419c-b0f3-627adb85feea tempest-GroupSnapshotsTest-696014180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853" returned: 0 in 0.674s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e5d183d4-0631-419c-b0f3-627adb85feea tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:38 devstack sudo[94838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853
Sep 04 15:54:38 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:38 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e3898e74-95a7-4e35-aae7-d0bd72c7b2d5 tempest-SnapshotsActionsTest-1042333865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c" returned: 0 in 0.601s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-e3898e74-95a7-4e35-aae7-d0bd72c7b2d5 tempest-SnapshotsActionsTest-1042333865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebffe5cd-7119-4fcb-a579-866179123e73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:54:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e3898e74-95a7-4e35-aae7-d0bd72c7b2d5 tempest-SnapshotsActionsTest-1042333865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:38 devstack sudo[94845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c
Sep 04 15:54:38 devstack sudo[94845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:38 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e5d183d4-0631-419c-b0f3-627adb85feea tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-750a1ba7-db2b-4666-8dfd-741d7fdb3853" returned: 0 in 0.418s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:38 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e5d183d4-0631-419c-b0f3-627adb85feea tempest-GroupSnapshotsTest-696014180 None] Lock "cinder-quobyte-750a1ba7-db2b-4666-8dfd-741d7fdb3853" released by "delete_volume" :: held 1.195s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:39 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-e5d183d4-0631-419c-b0f3-627adb85feea tempest-GroupSnapshotsTest-696014180 None] Created reservations ['d89e55c4-a6dc-44c5-b782-1c3a316544fc'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:54:39 devstack cinder-volume[87504]: WARNING cinder.quota [None req-e5d183d4-0631-419c-b0f3-627adb85feea tempest-GroupSnapshotsTest-696014180 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-69721352 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-69721352, it is now deprecated. Please use the default quota class for default quota.
Sep 04 15:54:39 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-e5d183d4-0631-419c-b0f3-627adb85feea tempest-GroupSnapshotsTest-696014180 None] Created reservations ['6c63fd44-fcab-4738-98c1-ea176e3e7e8d', 'b7855e7b-514b-4958-8dd1-805d7b35bd18', 'bc21615a-6d2d-4507-b3ad-ad6b2ac4046a', '613d192f-5de4-4666-99e7-6992b3fa1570'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:54:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e5d183d4-0631-419c-b0f3-627adb85feea tempest-GroupSnapshotsTest-696014180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:54:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e5d183d4-0631-419c-b0f3-627adb85feea tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:54:39 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e5d183d4-0631-419c-b0f3-627adb85feea tempest-GroupSnapshotsTest-696014180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:54:39 devstack sudo[94845]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:39 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e5d183d4-0631-419c-b0f3-627adb85feea tempest-GroupSnapshotsTest-696014180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:54:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e5d183d4-0631-419c-b0f3-627adb85feea tempest-GroupSnapshotsTest-696014180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:54:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e5d183d4-0631-419c-b0f3-627adb85feea tempest-GroupSnapshotsTest-696014180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e3898e74-95a7-4e35-aae7-d0bd72c7b2d5 tempest-SnapshotsActionsTest-1042333865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c" returned: 0 in 0.679s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e3898e74-95a7-4e35-aae7-d0bd72c7b2d5 tempest-SnapshotsActionsTest-1042333865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:39 devstack sudo[94854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c
Sep 04 15:54:39 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:39 devstack sudo[94853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:54:39 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:39 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e3898e74-95a7-4e35-aae7-d0bd72c7b2d5 tempest-SnapshotsActionsTest-1042333865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c" returned: 0 in 0.329s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:39 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e3898e74-95a7-4e35-aae7-d0bd72c7b2d5 tempest-SnapshotsActionsTest-1042333865 None] Lock "cinder-quobyte-b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c" released by "_delete_snapshot" :: held 2.512s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:39 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e3898e74-95a7-4e35-aae7-d0bd72c7b2d5 tempest-SnapshotsActionsTest-1042333865 None] Lock "cinder-quobyte-ebffe5cd-7119-4fcb-a579-866179123e73" released by "delete_snapshot" :: held 2.563s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:39 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e5d183d4-0631-419c-b0f3-627adb85feea tempest-GroupSnapshotsTest-696014180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.456s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:39 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-e5d183d4-0631-419c-b0f3-627adb85feea tempest-GroupSnapshotsTest-696014180 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:54:39 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e5d183d4-0631-419c-b0f3-627adb85feea tempest-GroupSnapshotsTest-696014180 None] Delete group completed successfully.
Sep 04 15:54:39 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-e3898e74-95a7-4e35-aae7-d0bd72c7b2d5 tempest-SnapshotsActionsTest-1042333865 None] Created reservations ['d78bf06c-a5f8-42f5-ad75-992d11cea6ad', '8265328f-ef86-4c0d-89e8-43859fcbb1af', 'c868e5fc-5c09-42d0-bbbc-c7507e434301', 'bb0e1436-8549-41eb-8b69-9b95ab41ff79'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:54:40 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e3898e74-95a7-4e35-aae7-d0bd72c7b2d5 tempest-SnapshotsActionsTest-1042333865 None] Delete snapshot completed successfully.
Sep 04 15:54:40 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e3898e74-95a7-4e35-aae7-d0bd72c7b2d5 tempest-SnapshotsActionsTest-1042333865 None] Lock "cinder-b6a17c45-a670-4ab0-a67c-ce1cd1d41b1c-delete_snapshot" released by "delete_snapshot" :: held 2.832s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-65888f0a-db6a-46fb-aa5f-0323e8f4de31 tempest-SnapshotsActionsTest-1895414665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:54:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-65888f0a-db6a-46fb-aa5f-0323e8f4de31 tempest-SnapshotsActionsTest-1895414665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:54:41 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-65888f0a-db6a-46fb-aa5f-0323e8f4de31 tempest-SnapshotsActionsTest-1895414665 None] Creating offline snapshot f24c2a76-a2aa-40ca-afe3-836f18bfd31d of volume ebffe5cd-7119-4fcb-a579-866179123e73 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:54:41 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06d067f-ae54-4ac2-8543-dd6247c81730]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-65888f0a-db6a-46fb-aa5f-0323e8f4de31 tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:41 devstack sudo[94876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c
Sep 04 15:54:41 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:41 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-65888f0a-db6a-46fb-aa5f-0323e8f4de31 tempest-SnapshotsActionsTest-1895414665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c" returned: 0 in 0.502s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:41 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-65888f0a-db6a-46fb-aa5f-0323e8f4de31 tempest-SnapshotsActionsTest-1895414665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebffe5cd-7119-4fcb-a579-866179123e73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:54:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-65888f0a-db6a-46fb-aa5f-0323e8f4de31 tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.f24c2a76-a2aa-40ca-afe3-836f18bfd31d 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:41 devstack sudo[94882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.f24c2a76-a2aa-40ca-afe3-836f18bfd31d 1G
Sep 04 15:54:41 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:42 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-65888f0a-db6a-46fb-aa5f-0323e8f4de31 tempest-SnapshotsActionsTest-1895414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.f24c2a76-a2aa-40ca-afe3-836f18bfd31d 1G" returned: 0 in 0.681s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-65888f0a-db6a-46fb-aa5f-0323e8f4de31 tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.f24c2a76-a2aa-40ca-afe3-836f18bfd31d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:42 devstack sudo[94890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.f24c2a76-a2aa-40ca-afe3-836f18bfd31d
Sep 04 15:54:42 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:42 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-65888f0a-db6a-46fb-aa5f-0323e8f4de31 tempest-SnapshotsActionsTest-1895414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.f24c2a76-a2aa-40ca-afe3-836f18bfd31d" returned: 0 in 0.359s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:42 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-65888f0a-db6a-46fb-aa5f-0323e8f4de31 tempest-SnapshotsActionsTest-1895414665 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.f24c2a76-a2aa-40ca-afe3-836f18bfd31d is being set with open permissions: ugo+rw
Sep 04 15:54:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-65888f0a-db6a-46fb-aa5f-0323e8f4de31 tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.f24c2a76-a2aa-40ca-afe3-836f18bfd31d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:42 devstack sudo[94899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.f24c2a76-a2aa-40ca-afe3-836f18bfd31d
Sep 04 15:54:42 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:42 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-b7b7f9b2-c14c-44ea-a81a-386a1e2a82be req-774047d1-2a6d-4797-85d0-aa36b0b3e675 tempest-AttachVolumeNegativeTest-866639513 None] Terminate volume connection completed successfully.
Sep 04 15:54:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-b7b7f9b2-c14c-44ea-a81a-386a1e2a82be req-774047d1-2a6d-4797-85d0-aa36b0b3e675 tempest-AttachVolumeNegativeTest-866639513 None] Deleting attachment 6a32f133-a53f-4530-a3d8-9b995149f224. {{(pid=87504) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 15:54:42 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-65888f0a-db6a-46fb-aa5f-0323e8f4de31 tempest-SnapshotsActionsTest-1895414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.f24c2a76-a2aa-40ca-afe3-836f18bfd31d" returned: 0 in 0.286s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-65888f0a-db6a-46fb-aa5f-0323e8f4de31 tempest-SnapshotsActionsTest-1895414665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.978s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:54:42 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-65888f0a-db6a-46fb-aa5f-0323e8f4de31 tempest-SnapshotsActionsTest-1895414665 None] Create snapshot completed successfully
Sep 04 15:54:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5c33b4f3-8d3c-46df-87e4-313075543967 tempest-SnapshotsActionsTest-1042333865 None] Acquiring lock "cinder-f24c2a76-a2aa-40ca-afe3-836f18bfd31d-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5c33b4f3-8d3c-46df-87e4-313075543967 tempest-SnapshotsActionsTest-1042333865 None] Lock "cinder-f24c2a76-a2aa-40ca-afe3-836f18bfd31d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5c33b4f3-8d3c-46df-87e4-313075543967 tempest-SnapshotsActionsTest-1042333865 None] Acquiring lock "cinder-quobyte-ebffe5cd-7119-4fcb-a579-866179123e73" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5c33b4f3-8d3c-46df-87e4-313075543967 tempest-SnapshotsActionsTest-1042333865 None] Lock "cinder-quobyte-ebffe5cd-7119-4fcb-a579-866179123e73" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5c33b4f3-8d3c-46df-87e4-313075543967 tempest-SnapshotsActionsTest-1042333865 None] Acquiring lock "cinder-quobyte-f24c2a76-a2aa-40ca-afe3-836f18bfd31d" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5c33b4f3-8d3c-46df-87e4-313075543967 tempest-SnapshotsActionsTest-1042333865 None] Lock "cinder-quobyte-f24c2a76-a2aa-40ca-afe3-836f18bfd31d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-5c33b4f3-8d3c-46df-87e4-313075543967 tempest-SnapshotsActionsTest-1042333865 None] Deleting offline snapshot f24c2a76-a2aa-40ca-afe3-836f18bfd31d of volume ebffe5cd-7119-4fcb-a579-866179123e73 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 15:54:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-5c33b4f3-8d3c-46df-87e4-313075543967 tempest-SnapshotsActionsTest-1042333865 None] snapshot_file for this snap is: volume-ebffe5cd-7119-4fcb-a579-866179123e73.f24c2a76-a2aa-40ca-afe3-836f18bfd31d {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 15:54:43 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[899f61de-d39b-46a7-9f59-5113c002e365]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5c33b4f3-8d3c-46df-87e4-313075543967 tempest-SnapshotsActionsTest-1042333865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.f24c2a76-a2aa-40ca-afe3-836f18bfd31d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:43 devstack sudo[94902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.f24c2a76-a2aa-40ca-afe3-836f18bfd31d
Sep 04 15:54:43 devstack sudo[94902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:43 devstack sudo[94902]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5c33b4f3-8d3c-46df-87e4-313075543967 tempest-SnapshotsActionsTest-1042333865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.f24c2a76-a2aa-40ca-afe3-836f18bfd31d" returned: 0 in 0.462s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-5c33b4f3-8d3c-46df-87e4-313075543967 tempest-SnapshotsActionsTest-1042333865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebffe5cd-7119-4fcb-a579-866179123e73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:54:43 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[078b6f24-81b3-4b1d-b90c-03eb778f629b]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5c33b4f3-8d3c-46df-87e4-313075543967 tempest-SnapshotsActionsTest-1042333865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:43 devstack sudo[94908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c
Sep 04 15:54:43 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:44 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5c33b4f3-8d3c-46df-87e4-313075543967 tempest-SnapshotsActionsTest-1042333865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c" returned: 0 in 0.605s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-5c33b4f3-8d3c-46df-87e4-313075543967 tempest-SnapshotsActionsTest-1042333865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebffe5cd-7119-4fcb-a579-866179123e73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:54:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5c33b4f3-8d3c-46df-87e4-313075543967 tempest-SnapshotsActionsTest-1042333865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.f24c2a76-a2aa-40ca-afe3-836f18bfd31d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:44 devstack sudo[94934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.f24c2a76-a2aa-40ca-afe3-836f18bfd31d
Sep 04 15:54:44 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:44 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5c33b4f3-8d3c-46df-87e4-313075543967 tempest-SnapshotsActionsTest-1042333865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.f24c2a76-a2aa-40ca-afe3-836f18bfd31d" returned: 0 in 0.418s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5c33b4f3-8d3c-46df-87e4-313075543967 tempest-SnapshotsActionsTest-1042333865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.f24c2a76-a2aa-40ca-afe3-836f18bfd31d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:44 devstack sudo[94939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.f24c2a76-a2aa-40ca-afe3-836f18bfd31d
Sep 04 15:54:44 devstack sudo[94939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:45 devstack sudo[94939]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5c33b4f3-8d3c-46df-87e4-313075543967 tempest-SnapshotsActionsTest-1042333865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.f24c2a76-a2aa-40ca-afe3-836f18bfd31d" returned: 0 in 0.307s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:45 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5c33b4f3-8d3c-46df-87e4-313075543967 tempest-SnapshotsActionsTest-1042333865 None] Lock "cinder-quobyte-f24c2a76-a2aa-40ca-afe3-836f18bfd31d" released by "_delete_snapshot" :: held 1.926s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:45 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5c33b4f3-8d3c-46df-87e4-313075543967 tempest-SnapshotsActionsTest-1042333865 None] Lock "cinder-quobyte-ebffe5cd-7119-4fcb-a579-866179123e73" released by "delete_snapshot" :: held 1.956s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:45 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-5c33b4f3-8d3c-46df-87e4-313075543967 tempest-SnapshotsActionsTest-1042333865 None] Created reservations ['48703451-a4f9-4c39-b8c4-6f0ebcce9c15', '5df48470-064f-425d-8c74-68d038b5d2c0', 'c478585f-aa1f-4ec0-9abf-476c1fec78ef', 'f529ce12-5d15-4c16-8f40-d157cfc7f768'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:54:45 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-5c33b4f3-8d3c-46df-87e4-313075543967 tempest-SnapshotsActionsTest-1042333865 None] Delete snapshot completed successfully.
Sep 04 15:54:45 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5c33b4f3-8d3c-46df-87e4-313075543967 tempest-SnapshotsActionsTest-1042333865 None] Lock "cinder-f24c2a76-a2aa-40ca-afe3-836f18bfd31d-delete_snapshot" released by "delete_snapshot" :: held 2.199s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:46 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-fb6834dd-5e3b-42d2-878f-fbb5e566d039 tempest-GroupSnapshotsV319Test-1936037344 None] Group tempest-GroupSnapshotsV319Test-Group-1904254966: creating
Sep 04 15:54:46 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-fb6834dd-5e3b-42d2-878f-fbb5e566d039 tempest-GroupSnapshotsV319Test-1936037344 None] Group tempest-GroupSnapshotsV319Test-Group-1904254966: created successfully
Sep 04 15:54:46 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-fb6834dd-5e3b-42d2-878f-fbb5e566d039 tempest-GroupSnapshotsV319Test-1936037344 None] Create group completed successfully.
Sep 04 15:54:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8f740820-ff14-4b7d-9fef-2b19b1a0b1e3 tempest-SnapshotsActionsTest-1895414665 None] Acquiring lock "cinder-5eb40825-fa32-4d17-8436-1c38ea1e176c-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8f740820-ff14-4b7d-9fef-2b19b1a0b1e3 tempest-SnapshotsActionsTest-1895414665 None] Lock "cinder-5eb40825-fa32-4d17-8436-1c38ea1e176c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8f740820-ff14-4b7d-9fef-2b19b1a0b1e3 tempest-SnapshotsActionsTest-1895414665 None] Acquiring lock "cinder-quobyte-ebffe5cd-7119-4fcb-a579-866179123e73" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8f740820-ff14-4b7d-9fef-2b19b1a0b1e3 tempest-SnapshotsActionsTest-1895414665 None] Lock "cinder-quobyte-ebffe5cd-7119-4fcb-a579-866179123e73" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8f740820-ff14-4b7d-9fef-2b19b1a0b1e3 tempest-SnapshotsActionsTest-1895414665 None] Acquiring lock "cinder-quobyte-5eb40825-fa32-4d17-8436-1c38ea1e176c" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8f740820-ff14-4b7d-9fef-2b19b1a0b1e3 tempest-SnapshotsActionsTest-1895414665 None] Lock "cinder-quobyte-5eb40825-fa32-4d17-8436-1c38ea1e176c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:47 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-8f740820-ff14-4b7d-9fef-2b19b1a0b1e3 tempest-SnapshotsActionsTest-1895414665 None] Deleting offline snapshot 5eb40825-fa32-4d17-8436-1c38ea1e176c of volume ebffe5cd-7119-4fcb-a579-866179123e73 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 15:54:47 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-8f740820-ff14-4b7d-9fef-2b19b1a0b1e3 tempest-SnapshotsActionsTest-1895414665 None] snapshot_file for this snap is: volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 15:54:47 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc904969-362e-47ec-a86e-e399b6a7c035]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8f740820-ff14-4b7d-9fef-2b19b1a0b1e3 tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:47 devstack sudo[94945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c
Sep 04 15:54:47 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:47 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8f740820-ff14-4b7d-9fef-2b19b1a0b1e3 tempest-SnapshotsActionsTest-1895414665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c" returned: 0 in 0.420s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:47 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-8f740820-ff14-4b7d-9fef-2b19b1a0b1e3 tempest-SnapshotsActionsTest-1895414665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebffe5cd-7119-4fcb-a579-866179123e73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:54:47 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdaffc39-90c6-47c1-b416-0350c34632dd]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8f740820-ff14-4b7d-9fef-2b19b1a0b1e3 tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:47 devstack sudo[94950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73
Sep 04 15:54:47 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:48 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8f740820-ff14-4b7d-9fef-2b19b1a0b1e3 tempest-SnapshotsActionsTest-1895414665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73" returned: 0 in 0.520s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8f740820-ff14-4b7d-9fef-2b19b1a0b1e3 tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:48 devstack sudo[94955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c
Sep 04 15:54:48 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:48 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8f740820-ff14-4b7d-9fef-2b19b1a0b1e3 tempest-SnapshotsActionsTest-1895414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c" returned: 0 in 0.570s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8f740820-ff14-4b7d-9fef-2b19b1a0b1e3 tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:54:48 devstack sudo[94961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c
Sep 04 15:54:48 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:48 devstack sudo[94963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:54:48 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Flow 'volume_create_manager' (4595ebb8-1c1f-49f4-8808-2b2d2b97f471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2753fb03-0fd5-4306-8f2c-24965c956772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2753fb03-0fd5-4306-8f2c-24965c956772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-668731586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=12e90e36-6c72-42a9-af4b-8d1d739d9a09,host='devstack@QuobyteHD#QuobyteHD',id=76bd7d4c-2259-4c78-842b-268005eac3ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14aa0aa696c2474899bb69a614e7a28a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:49Z,use_quota=True,user_id='28b65d275b14427e846b3fcc473799c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae2a3da-aa7b-49c1-bdc6-3f5282856a82),volume_type_id=aae2a3da-aa7b-49c1-bdc6-3f5282856a82)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a124c3-ccde-473d-9807-935f99d3adc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a124c3-ccde-473d-9807-935f99d3adc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904bb11c-aa9b-40e2-871f-7fe9b0511b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904bb11c-aa9b-40e2-871f-7fe9b0511b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76bd7d4c-2259-4c78-842b-268005eac3ed', 'volume_name': 'volume-76bd7d4c-2259-4c78-842b-268005eac3ed', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309e4e8a-ed28-4d57-a61c-882d521d1047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309e4e8a-ed28-4d57-a61c-882d521d1047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c4118a-e634-4c6c-b6a4-b3427e17a1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:54:48 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Volume 76bd7d4c-2259-4c78-842b-268005eac3ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76bd7d4c-2259-4c78-842b-268005eac3ed', 'volume_size': 1}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=12e90e36-6c72-42a9-af4b-8d1d739d9a09,created_at=2026-09-04T13:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-668731586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=12e90e36-6c72-42a9-af4b-8d1d739d9a09,host='devstack@QuobyteHD#QuobyteHD',id=76bd7d4c-2259-4c78-842b-268005eac3ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14aa0aa696c2474899bb69a614e7a28a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:49Z,use_quota=True,user_id='28b65d275b14427e846b3fcc473799c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aae2a3da-aa7b-49c1-bdc6-3f5282856a82),volume_type_id=aae2a3da-aa7b-49c1-bdc6-3f5282856a82)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Creating volume 76bd7d4c-2259-4c78-842b-268005eac3ed {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:54:48 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:54:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:48 devstack sudo[94965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed 1073741824
Sep 04 15:54:48 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:49 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8f740820-ff14-4b7d-9fef-2b19b1a0b1e3 tempest-SnapshotsActionsTest-1895414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73.5eb40825-fa32-4d17-8436-1c38ea1e176c" returned: 0 in 0.435s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8f740820-ff14-4b7d-9fef-2b19b1a0b1e3 tempest-SnapshotsActionsTest-1895414665 None] Lock "cinder-quobyte-5eb40825-fa32-4d17-8436-1c38ea1e176c" released by "_delete_snapshot" :: held 2.109s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8f740820-ff14-4b7d-9fef-2b19b1a0b1e3 tempest-SnapshotsActionsTest-1895414665 None] Lock "cinder-quobyte-ebffe5cd-7119-4fcb-a579-866179123e73" released by "delete_snapshot" :: held 2.174s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:49 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.643s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:49 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:54:49 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager._thread_info {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:54:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread count: 28 {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 15:54:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread info: [<_MainThread(MainThread, started 131673838448768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131673724603200)>, <Thread(Thread-3 (stat_writer), started daemon 131673723495936)>, <Thread(Rabbit-heartbeat, started daemon 131673723764800)>, <Thread(Thread-5 (_runner), started daemon 131673722269632)>, <Thread(Thread-7 (_runner), started daemon 131673722322112)>, <Thread(fd_logger, started daemon 131673722585024)>, <Thread(privsep_reader, started daemon 131673721593984)>, <Thread(tpool_thread_0, started daemon 131673714706112)>, <Thread(tpool_thread_1, started daemon 131673706313408)>, <Thread(tpool_thread_2, started daemon 131673697920704)>, <Thread(tpool_thread_3, started daemon 131673689528000)>, <Thread(tpool_thread_4, started daemon 131673681135296)>, <Thread(tpool_thread_5, started daemon 131673672726208)>, <Thread(tpool_thread_6, started daemon 131673664317120)>, <Thread(tpool_thread_7, started daemon 131673655908032)>, <Thread(tpool_thread_8, started daemon 131673647498944)>, <Thread(tpool_thread_9, started daemon 131673639089856)>, <Thread(tpool_thread_10, started daemon 131673630680768)>, <Thread(tpool_thread_11, started daemon 131673622271680)>, <Thread(tpool_thread_12, started daemon 131673613862592)>, <Thread(tpool_thread_13, started daemon 131673605453504)>, <Thread(tpool_thread_14, started daemon 131673597044416)>, <Thread(tpool_thread_15, started daemon 131673588635328)>, <Thread(tpool_thread_16, started daemon 131673580226240)>, <Thread(tpool_thread_17, started daemon 131673571817152)>, <Thread(tpool_thread_18, started daemon 131673563408064)>, <Thread(tpool_thread_19, started daemon 131673554998976)>] {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 15:54:49 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-8f740820-ff14-4b7d-9fef-2b19b1a0b1e3 tempest-SnapshotsActionsTest-1895414665 None] Created reservations ['5a1d3b73-3178-4260-8794-24d863157310', 'f01179a5-0d02-4334-b800-b25e4edd8564', '8230db45-6f33-4d3b-93d3-57b5ca7401ac', 'f697a38c-ed16-487e-ac65-6d4a15d40b16'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:54:49 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-8f740820-ff14-4b7d-9fef-2b19b1a0b1e3 tempest-SnapshotsActionsTest-1895414665 None] Delete snapshot completed successfully.
Sep 04 15:54:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8f740820-ff14-4b7d-9fef-2b19b1a0b1e3 tempest-SnapshotsActionsTest-1895414665 None] Lock "cinder-5eb40825-fa32-4d17-8436-1c38ea1e176c-delete_snapshot" released by "delete_snapshot" :: held 2.467s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:49 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed 1073741824" returned: 0 in 0.737s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:49 devstack sudo[94973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed
Sep 04 15:54:49 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:50 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed" returned: 0 in 0.291s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:54:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:54:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c4118a-e634-4c6c-b6a4-b3427e17a1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76bd7d4c-2259-4c78-842b-268005eac3ed', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:54:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912397ab-a121-44a2-bc3a-0ce2d4de9cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:54:50 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Volume volume-76bd7d4c-2259-4c78-842b-268005eac3ed (76bd7d4c-2259-4c78-842b-268005eac3ed): created successfully
Sep 04 15:54:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912397ab-a121-44a2-bc3a-0ce2d4de9cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:54:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Flow 'volume_create_manager' (4595ebb8-1c1f-49f4-8808-2b2d2b97f471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:54:50 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-52b17a33-629c-4bf4-8e80-812564c62fa2 tempest-GroupSnapshotsV319Test-1936037344 None] Created volume successfully.
Sep 04 15:54:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e2906734-60a8-4767-ae45-bf1f6a7420ef tempest-SnapshotsActionsTest-1895414665 None] Acquiring lock "cinder-ebffe5cd-7119-4fcb-a579-866179123e73-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e2906734-60a8-4767-ae45-bf1f6a7420ef tempest-SnapshotsActionsTest-1895414665 None] Lock "cinder-ebffe5cd-7119-4fcb-a579-866179123e73-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e2906734-60a8-4767-ae45-bf1f6a7420ef tempest-SnapshotsActionsTest-1895414665 None] Acquiring lock "cinder-quobyte-ebffe5cd-7119-4fcb-a579-866179123e73" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e2906734-60a8-4767-ae45-bf1f6a7420ef tempest-SnapshotsActionsTest-1895414665 None] Lock "cinder-quobyte-ebffe5cd-7119-4fcb-a579-866179123e73" acquired by "delete_volume" :: waited 0.029s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:50 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9043d7f8-214f-4ca4-a45c-0a0d17e8c192]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e2906734-60a8-4767-ae45-bf1f6a7420ef tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:50 devstack sudo[94983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73
Sep 04 15:54:50 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:50 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-33ccf10c-2cc0-42ca-8ba4-e611a724f741 tempest-GroupSnapshotsV319Test-1936037344 None] GroupSnapshot 868b514c-67a8-453a-a6bd-a00fd1f5da4b: creating.
Sep 04 15:54:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-33ccf10c-2cc0-42ca-8ba4-e611a724f741 tempest-GroupSnapshotsV319Test-1936037344 None] Group snapshot 868b514c-67a8-453a-a6bd-a00fd1f5da4b: creating. {{(pid=87504) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 04 15:54:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-33ccf10c-2cc0-42ca-8ba4-e611a724f741 tempest-GroupSnapshotsV319Test-1936037344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:54:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-33ccf10c-2cc0-42ca-8ba4-e611a724f741 tempest-GroupSnapshotsV319Test-1936037344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-33ccf10c-2cc0-42ca-8ba4-e611a724f741 tempest-GroupSnapshotsV319Test-1936037344 None] Creating offline snapshot 8bfca2de-659d-434c-afb8-a25ebc467e84 of volume 76bd7d4c-2259-4c78-842b-268005eac3ed {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6d0269-bcf6-40f1-bcd6-cc2a914a06f7]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-33ccf10c-2cc0-42ca-8ba4-e611a724f741 tempest-GroupSnapshotsV319Test-1936037344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Flow 'volume_create_manager' (185d688f-3503-488f-8e22-cd03ab2f5cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6197f6-4623-49ea-a405-fc914e6d0888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6197f6-4623-49ea-a405-fc914e6d0888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-450795704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e25c7c5faf84a5683492c9d67c93f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:51Z,use_quota=True,user_id='b379860e0b1c4ce58d44a249eea49db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8efc5f27-661e-4d63-91ac-b6ddfccc2cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8efc5f27-661e-4d63-91ac-b6ddfccc2cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57933ac8-512a-4ba5-a02b-811ca582d72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57933ac8-512a-4ba5-a02b-811ca582d72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6', 'volume_name': 'volume-07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1982114-6b86-49d3-aa77-cb2a3296795e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1982114-6b86-49d3-aa77-cb2a3296795e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f1b93e-ab44-4cee-9c58-c3bc03f301a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:54:51 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Volume 07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6', 'volume_size': 1}
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:54:51 devstack sudo[94985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed
Sep 04 15:54:51 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:51 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e2906734-60a8-4767-ae45-bf1f6a7420ef tempest-SnapshotsActionsTest-1895414665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73" returned: 0 in 0.668s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e2906734-60a8-4767-ae45-bf1f6a7420ef tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:51 devstack sudo[94990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73
Sep 04 15:54:51 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:51 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-33ccf10c-2cc0-42ca-8ba4-e611a724f741 tempest-GroupSnapshotsV319Test-1936037344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed" returned: 0 in 0.490s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-33ccf10c-2cc0-42ca-8ba4-e611a724f741 tempest-GroupSnapshotsV319Test-1936037344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.8bfca2de-659d-434c-afb8-a25ebc467e84 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:51 devstack sudo[94996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.8bfca2de-659d-434c-afb8-a25ebc467e84 1G
Sep 04 15:54:51 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:51 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e2906734-60a8-4767-ae45-bf1f6a7420ef tempest-SnapshotsActionsTest-1895414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ebffe5cd-7119-4fcb-a579-866179123e73" returned: 0 in 0.313s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e2906734-60a8-4767-ae45-bf1f6a7420ef tempest-SnapshotsActionsTest-1895414665 None] Lock "cinder-quobyte-ebffe5cd-7119-4fcb-a579-866179123e73" released by "delete_volume" :: held 1.104s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-e2906734-60a8-4767-ae45-bf1f6a7420ef tempest-SnapshotsActionsTest-1895414665 None] Created reservations ['9230abc3-3a8a-4e85-a806-9b6d9c5c3fd3', '7b911ff9-aece-40d0-bb4d-4dcff250fefa', '7d146f2e-a383-4a1a-9300-e87118c574a6', '9c09986d-9b61-4b81-8372-80901d169694'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e2906734-60a8-4767-ae45-bf1f6a7420ef tempest-SnapshotsActionsTest-1895414665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e2906734-60a8-4767-ae45-bf1f6a7420ef tempest-SnapshotsActionsTest-1895414665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e2906734-60a8-4767-ae45-bf1f6a7420ef tempest-SnapshotsActionsTest-1895414665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e2906734-60a8-4767-ae45-bf1f6a7420ef tempest-SnapshotsActionsTest-1895414665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e2906734-60a8-4767-ae45-bf1f6a7420ef tempest-SnapshotsActionsTest-1895414665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:54:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e2906734-60a8-4767-ae45-bf1f6a7420ef tempest-SnapshotsActionsTest-1895414665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:51 devstack sudo[94998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:54:51 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:52 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-33ccf10c-2cc0-42ca-8ba4-e611a724f741 tempest-GroupSnapshotsV319Test-1936037344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.8bfca2de-659d-434c-afb8-a25ebc467e84 1G" returned: 0 in 0.569s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-33ccf10c-2cc0-42ca-8ba4-e611a724f741 tempest-GroupSnapshotsV319Test-1936037344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76bd7d4c-2259-4c78-842b-268005eac3ed -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.8bfca2de-659d-434c-afb8-a25ebc467e84 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:52 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e2906734-60a8-4767-ae45-bf1f6a7420ef tempest-SnapshotsActionsTest-1895414665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.342s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:52 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-e2906734-60a8-4767-ae45-bf1f6a7420ef tempest-SnapshotsActionsTest-1895414665 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:54:52 devstack sudo[95005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76bd7d4c-2259-4c78-842b-268005eac3ed -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.8bfca2de-659d-434c-afb8-a25ebc467e84
Sep 04 15:54:52 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:52 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e2906734-60a8-4767-ae45-bf1f6a7420ef tempest-SnapshotsActionsTest-1895414665 None] Deleted volume successfully.
Sep 04 15:54:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e2906734-60a8-4767-ae45-bf1f6a7420ef tempest-SnapshotsActionsTest-1895414665 None] Lock "cinder-ebffe5cd-7119-4fcb-a579-866179123e73-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:52 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-33ccf10c-2cc0-42ca-8ba4-e611a724f741 tempest-GroupSnapshotsV319Test-1936037344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76bd7d4c-2259-4c78-842b-268005eac3ed -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.8bfca2de-659d-434c-afb8-a25ebc467e84" returned: 0 in 0.353s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:52 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-33ccf10c-2cc0-42ca-8ba4-e611a724f741 tempest-GroupSnapshotsV319Test-1936037344 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.8bfca2de-659d-434c-afb8-a25ebc467e84 is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 15:54:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-33ccf10c-2cc0-42ca-8ba4-e611a724f741 tempest-GroupSnapshotsV319Test-1936037344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.8bfca2de-659d-434c-afb8-a25ebc467e84 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:52 devstack sudo[95011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.8bfca2de-659d-434c-afb8-a25ebc467e84
Sep 04 15:54:52 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:52 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-33ccf10c-2cc0-42ca-8ba4-e611a724f741 tempest-GroupSnapshotsV319Test-1936037344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.8bfca2de-659d-434c-afb8-a25ebc467e84" returned: 0 in 0.283s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-33ccf10c-2cc0-42ca-8ba4-e611a724f741 tempest-GroupSnapshotsV319Test-1936037344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:52 devstack sudo[95014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.info
Sep 04 15:54:52 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:53 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-33ccf10c-2cc0-42ca-8ba4-e611a724f741 tempest-GroupSnapshotsV319Test-1936037344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.info" returned: 0 in 0.310s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:53 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-33ccf10c-2cc0-42ca-8ba4-e611a724f741 tempest-GroupSnapshotsV319Test-1936037344 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 15:54:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-33ccf10c-2cc0-42ca-8ba4-e611a724f741 tempest-GroupSnapshotsV319Test-1936037344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:53 devstack sudo[95017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.info
Sep 04 15:54:53 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:53 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-33ccf10c-2cc0-42ca-8ba4-e611a724f741 tempest-GroupSnapshotsV319Test-1936037344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.info" returned: 0 in 0.394s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-33ccf10c-2cc0-42ca-8ba4-e611a724f741 tempest-GroupSnapshotsV319Test-1936037344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.529s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:54:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.292s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:54:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-450795704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e25c7c5faf84a5683492c9d67c93f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:51Z,use_quota=True,user_id='b379860e0b1c4ce58d44a249eea49db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:54:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Creating volume 07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:54:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:54:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:54:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:54:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:54:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:54:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:54:53 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:54:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:53 devstack sudo[95023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6 1073741824
Sep 04 15:54:53 devstack sudo[95023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:53 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-33ccf10c-2cc0-42ca-8ba4-e611a724f741 tempest-GroupSnapshotsV319Test-1936037344 None] group_snapshot 868b514c-67a8-453a-a6bd-a00fd1f5da4b: created successfully
Sep 04 15:54:54 devstack sudo[95023]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6 1073741824" returned: 0 in 0.688s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:54 devstack sudo[95031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6
Sep 04 15:54:54 devstack sudo[95031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:54 devstack sudo[95031]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6" returned: 0 in 0.464s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:54:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:54:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f1b93e-ab44-4cee-9c58-c3bc03f301a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:54:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8766ff8e-1f9b-46dd-bd4a-502caf2d70da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:54:54 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Volume volume-07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6 (07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6): created successfully
Sep 04 15:54:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8766ff8e-1f9b-46dd-bd4a-502caf2d70da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:54:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Flow 'volume_create_manager' (185d688f-3503-488f-8e22-cd03ab2f5cdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:54:54 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-d504b7ef-8de8-4793-980b-e67127168637 tempest-AttachVolumeTestJSON-1246579971 None] Created volume successfully.
Sep 04 15:54:54 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-d09815ba-875d-48b8-9b68-c21c3ba5fd3a tempest-GroupSnapshotsV319Test-1936037344 None] group_snapshot 868b514c-67a8-453a-a6bd-a00fd1f5da4b: deleting
Sep 04 15:54:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d09815ba-875d-48b8-9b68-c21c3ba5fd3a tempest-GroupSnapshotsV319Test-1936037344 None] group_snapshot 868b514c-67a8-453a-a6bd-a00fd1f5da4b: deleting {{(pid=87504) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 04 15:54:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d09815ba-875d-48b8-9b68-c21c3ba5fd3a tempest-GroupSnapshotsV319Test-1936037344 None] Acquiring lock "cinder-quobyte-76bd7d4c-2259-4c78-842b-268005eac3ed" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d09815ba-875d-48b8-9b68-c21c3ba5fd3a tempest-GroupSnapshotsV319Test-1936037344 None] Lock "cinder-quobyte-76bd7d4c-2259-4c78-842b-268005eac3ed" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d09815ba-875d-48b8-9b68-c21c3ba5fd3a tempest-GroupSnapshotsV319Test-1936037344 None] Acquiring lock "cinder-quobyte-8bfca2de-659d-434c-afb8-a25ebc467e84" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d09815ba-875d-48b8-9b68-c21c3ba5fd3a tempest-GroupSnapshotsV319Test-1936037344 None] Lock "cinder-quobyte-8bfca2de-659d-434c-afb8-a25ebc467e84" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-d09815ba-875d-48b8-9b68-c21c3ba5fd3a tempest-GroupSnapshotsV319Test-1936037344 None] Deleting offline snapshot 8bfca2de-659d-434c-afb8-a25ebc467e84 of volume 76bd7d4c-2259-4c78-842b-268005eac3ed {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 15:54:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-d09815ba-875d-48b8-9b68-c21c3ba5fd3a tempest-GroupSnapshotsV319Test-1936037344 None] snapshot_file for this snap is: volume-76bd7d4c-2259-4c78-842b-268005eac3ed.8bfca2de-659d-434c-afb8-a25ebc467e84 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 15:54:55 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[90153c9b-2866-4cd8-acfa-512625964f3a]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d09815ba-875d-48b8-9b68-c21c3ba5fd3a tempest-GroupSnapshotsV319Test-1936037344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.8bfca2de-659d-434c-afb8-a25ebc467e84 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:55 devstack sudo[95034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.8bfca2de-659d-434c-afb8-a25ebc467e84
Sep 04 15:54:55 devstack sudo[95034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:55 devstack sudo[95034]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d09815ba-875d-48b8-9b68-c21c3ba5fd3a tempest-GroupSnapshotsV319Test-1936037344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.8bfca2de-659d-434c-afb8-a25ebc467e84" returned: 0 in 0.703s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-d09815ba-875d-48b8-9b68-c21c3ba5fd3a tempest-GroupSnapshotsV319Test-1936037344 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76bd7d4c-2259-4c78-842b-268005eac3ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:54:55 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bc00b7-dce5-4fc2-9b3e-b324a78aaf0f]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d09815ba-875d-48b8-9b68-c21c3ba5fd3a tempest-GroupSnapshotsV319Test-1936037344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:56 devstack sudo[95054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed
Sep 04 15:54:56 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:56 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d09815ba-875d-48b8-9b68-c21c3ba5fd3a tempest-GroupSnapshotsV319Test-1936037344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed" returned: 0 in 0.551s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d09815ba-875d-48b8-9b68-c21c3ba5fd3a tempest-GroupSnapshotsV319Test-1936037344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.8bfca2de-659d-434c-afb8-a25ebc467e84 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:56 devstack sudo[95065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.8bfca2de-659d-434c-afb8-a25ebc467e84
Sep 04 15:54:56 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:57 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d09815ba-875d-48b8-9b68-c21c3ba5fd3a tempest-GroupSnapshotsV319Test-1936037344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.8bfca2de-659d-434c-afb8-a25ebc467e84" returned: 0 in 0.628s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d09815ba-875d-48b8-9b68-c21c3ba5fd3a tempest-GroupSnapshotsV319Test-1936037344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.8bfca2de-659d-434c-afb8-a25ebc467e84 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:57 devstack sudo[95102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.8bfca2de-659d-434c-afb8-a25ebc467e84
Sep 04 15:54:57 devstack sudo[95102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:57 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=128,cinder:INSERT=31,cinder:UPDATE=119,cinder:DELETE=7 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:54:57 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:UPDATE=121,cinder:SELECT=127,cinder:INSERT=30,cinder:DELETE=5 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:54:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-d755e0d2-2b08-4926-b358-09a228036293 req-bb35b66b-5e4e-4a37-b19a-fcdc2af83ca8 tempest-AttachVolumeTestJSON-1246579971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:54:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-d755e0d2-2b08-4926-b358-09a228036293 req-bb35b66b-5e4e-4a37-b19a-fcdc2af83ca8 tempest-AttachVolumeTestJSON-1246579971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:54:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-d755e0d2-2b08-4926-b358-09a228036293 req-bb35b66b-5e4e-4a37-b19a-fcdc2af83ca8 tempest-AttachVolumeTestJSON-1246579971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:54:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-d755e0d2-2b08-4926-b358-09a228036293 req-bb35b66b-5e4e-4a37-b19a-fcdc2af83ca8 tempest-AttachVolumeTestJSON-1246579971 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236', 'name': 'volume-07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f06461d-4eb7-4cde-94c0-564c78aa6fb9', 'enforce_multipath': True} {{(pid=87504) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 15:54:57 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-d755e0d2-2b08-4926-b358-09a228036293 req-bb35b66b-5e4e-4a37-b19a-fcdc2af83ca8 tempest-AttachVolumeTestJSON-1246579971 None] attachment_update completed successfully.
Sep 04 15:54:57 devstack sudo[95102]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d09815ba-875d-48b8-9b68-c21c3ba5fd3a tempest-GroupSnapshotsV319Test-1936037344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed.8bfca2de-659d-434c-afb8-a25ebc467e84" returned: 0 in 0.462s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d09815ba-875d-48b8-9b68-c21c3ba5fd3a tempest-GroupSnapshotsV319Test-1936037344 None] Lock "cinder-quobyte-8bfca2de-659d-434c-afb8-a25ebc467e84" released by "_delete_snapshot" :: held 2.521s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d09815ba-875d-48b8-9b68-c21c3ba5fd3a tempest-GroupSnapshotsV319Test-1936037344 None] Lock "cinder-quobyte-76bd7d4c-2259-4c78-842b-268005eac3ed" released by "delete_snapshot" :: held 2.576s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:54:57 devstack cinder-volume[87504]: WARNING cinder.quota [None req-d09815ba-875d-48b8-9b68-c21c3ba5fd3a tempest-GroupSnapshotsV319Test-1936037344 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1329096384 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1329096384, it is now deprecated. Please use the default quota class for default quota.
Sep 04 15:54:57 devstack cinder-volume[87504]: WARNING cinder.quota [None req-d09815ba-875d-48b8-9b68-c21c3ba5fd3a tempest-GroupSnapshotsV319Test-1936037344 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1329096384 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1329096384, it is now deprecated. Please use the default quota class for default quota.
Sep 04 15:54:57 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-d09815ba-875d-48b8-9b68-c21c3ba5fd3a tempest-GroupSnapshotsV319Test-1936037344 None] Created reservations ['b0fe2fa8-9256-4017-ace7-141a32e39415', '7cf129d4-7d83-4306-ad1d-b12e86ab5885', '0168d995-f104-4205-90cb-14286ce84bd7', '78ecb850-4285-4255-856c-1cc32aa3fcb3'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:54:58 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-d09815ba-875d-48b8-9b68-c21c3ba5fd3a tempest-GroupSnapshotsV319Test-1936037344 None] group_snapshot 868b514c-67a8-453a-a6bd-a00fd1f5da4b: deleted successfully
Sep 04 15:54:58 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-00fe8f8e-bd0b-4a95-8108-cd6abe1f7900 tempest-GroupSnapshotsV319Test-1936037344 None] Acquiring lock "cinder-quobyte-76bd7d4c-2259-4c78-842b-268005eac3ed" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:54:58 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-00fe8f8e-bd0b-4a95-8108-cd6abe1f7900 tempest-GroupSnapshotsV319Test-1936037344 None] Lock "cinder-quobyte-76bd7d4c-2259-4c78-842b-268005eac3ed" acquired by "delete_volume" :: waited 0.016s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:54:58 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2eb35cc-6540-4b80-afce-c4da8fce3b8a]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:54:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-00fe8f8e-bd0b-4a95-8108-cd6abe1f7900 tempest-GroupSnapshotsV319Test-1936037344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:59 devstack sudo[95502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed
Sep 04 15:54:59 devstack sudo[95502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:54:59 devstack sudo[95502]: pam_unix(sudo:session): session closed for user root
Sep 04 15:54:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-00fe8f8e-bd0b-4a95-8108-cd6abe1f7900 tempest-GroupSnapshotsV319Test-1936037344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed" returned: 0 in 0.929s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:54:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-00fe8f8e-bd0b-4a95-8108-cd6abe1f7900 tempest-GroupSnapshotsV319Test-1936037344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:54:59 devstack sudo[95559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed
Sep 04 15:54:59 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:55:00 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root
Sep 04 15:55:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-00fe8f8e-bd0b-4a95-8108-cd6abe1f7900 tempest-GroupSnapshotsV319Test-1936037344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bd7d4c-2259-4c78-842b-268005eac3ed" returned: 0 in 0.593s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:55:00 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-00fe8f8e-bd0b-4a95-8108-cd6abe1f7900 tempest-GroupSnapshotsV319Test-1936037344 None] Lock "cinder-quobyte-76bd7d4c-2259-4c78-842b-268005eac3ed" released by "delete_volume" :: held 1.700s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:55:00 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-00fe8f8e-bd0b-4a95-8108-cd6abe1f7900 tempest-GroupSnapshotsV319Test-1936037344 None] Created reservations ['815a3b5b-02fc-4993-a946-d4fb8a42e676'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:55:00 devstack cinder-volume[87504]: WARNING cinder.quota [None req-00fe8f8e-bd0b-4a95-8108-cd6abe1f7900 tempest-GroupSnapshotsV319Test-1936037344 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1329096384 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1329096384, it is now deprecated. Please use the default quota class for default quota.
Sep 04 15:55:00 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-00fe8f8e-bd0b-4a95-8108-cd6abe1f7900 tempest-GroupSnapshotsV319Test-1936037344 None] Created reservations ['8a850ef8-b724-404f-9ab6-aefb34f20b81', '877a1efb-4f79-47e4-9e2f-6e3b8fbd9deb', '9ee13932-a0b5-41d7-891f-e98f88e6f408', '84e03834-fc33-451c-bed8-197a40abde27'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:55:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-00fe8f8e-bd0b-4a95-8108-cd6abe1f7900 tempest-GroupSnapshotsV319Test-1936037344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:55:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-00fe8f8e-bd0b-4a95-8108-cd6abe1f7900 tempest-GroupSnapshotsV319Test-1936037344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:55:01 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-00fe8f8e-bd0b-4a95-8108-cd6abe1f7900 tempest-GroupSnapshotsV319Test-1936037344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:55:01 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-00fe8f8e-bd0b-4a95-8108-cd6abe1f7900 tempest-GroupSnapshotsV319Test-1936037344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:55:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-00fe8f8e-bd0b-4a95-8108-cd6abe1f7900 tempest-GroupSnapshotsV319Test-1936037344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:55:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-00fe8f8e-bd0b-4a95-8108-cd6abe1f7900 tempest-GroupSnapshotsV319Test-1936037344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:55:01 devstack sudo[95803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:55:01 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:55:01 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root
Sep 04 15:55:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-00fe8f8e-bd0b-4a95-8108-cd6abe1f7900 tempest-GroupSnapshotsV319Test-1936037344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.531s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:55:01 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-00fe8f8e-bd0b-4a95-8108-cd6abe1f7900 tempest-GroupSnapshotsV319Test-1936037344 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:55:01 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-00fe8f8e-bd0b-4a95-8108-cd6abe1f7900 tempest-GroupSnapshotsV319Test-1936037344 None] Delete group completed successfully.
Sep 04 15:55:11 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=20,cinder:UPDATE=16,cinder:INSERT=6 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:55:11 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=18,cinder:INSERT=3,cinder:UPDATE=21 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:55:12 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:55:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Flow 'volume_create_manager' (19556be4-b7c4-4997-b1eb-308c5387fd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:55:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f31fa04-7ca3-4852-a74b-1cb74af3e357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:55:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f31fa04-7ca3-4852-a74b-1cb74af3e357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1227522115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='221cd3233f7e48ffa3d99b8934e0c457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:12Z,use_quota=True,user_id='4f7ee59006194a7780903dd3dc12ef7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5759bcaf-c919-4844-9ece-8ecd7f00ea2a),volume_type_id=5759bcaf-c919-4844-9ece-8ecd7f00ea2a)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:55:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9279667-ce78-4e49-a1cc-34e43c2fb34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:55:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9279667-ce78-4e49-a1cc-34e43c2fb34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:55:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd5bc82-2730-412b-9a0a-81081c9da6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:55:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd5bc82-2730-412b-9a0a-81081c9da6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e', 'volume_name': 'volume-f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:55:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb8bb7d-8bdc-4f76-867e-67fed1b6af43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:55:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb8bb7d-8bdc-4f76-867e-67fed1b6af43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:55:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372a6217-5532-4bb9-9ddf-2f9b05af112e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:55:12 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Volume f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e', 'volume_size': 1}
Sep 04 15:55:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:55:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:55:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1227522115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='221cd3233f7e48ffa3d99b8934e0c457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:12Z,use_quota=True,user_id='4f7ee59006194a7780903dd3dc12ef7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5759bcaf-c919-4844-9ece-8ecd7f00ea2a),volume_type_id=5759bcaf-c919-4844-9ece-8ecd7f00ea2a)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:55:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Creating volume f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:55:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:55:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:55:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:55:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:55:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:55:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:55:12 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:55:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:55:12 devstack sudo[96516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e 1073741824
Sep 04 15:55:12 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:55:13 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root
Sep 04 15:55:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e 1073741824" returned: 0 in 0.567s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:55:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:55:13 devstack sudo[96522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e
Sep 04 15:55:13 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:55:13 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root
Sep 04 15:55:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e" returned: 0 in 0.336s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:55:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:55:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:55:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372a6217-5532-4bb9-9ddf-2f9b05af112e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:55:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbcc751-d552-484b-b53d-9768f4a2ce08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:55:13 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Volume volume-f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e (f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e): created successfully
Sep 04 15:55:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbcc751-d552-484b-b53d-9768f4a2ce08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:55:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Flow 'volume_create_manager' (19556be4-b7c4-4997-b1eb-308c5387fd1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:55:13 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-79494fc1-a20b-4ade-bf6b-063f030924ba tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Created volume successfully.
Sep 04 15:55:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-68f42fdd-ef02-4af8-bc9a-a2d675f1ff8e tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:55:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-68f42fdd-ef02-4af8-bc9a-a2d675f1ff8e tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:55:15 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-68f42fdd-ef02-4af8-bc9a-a2d675f1ff8e tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:55:15 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-68f42fdd-ef02-4af8-bc9a-a2d675f1ff8e tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:55:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-68f42fdd-ef02-4af8-bc9a-a2d675f1ff8e tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:55:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-68f42fdd-ef02-4af8-bc9a-a2d675f1ff8e tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:55:15 devstack sudo[96550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:55:15 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:55:15 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root
Sep 04 15:55:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-68f42fdd-ef02-4af8-bc9a-a2d675f1ff8e tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.314s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:55:15 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-68f42fdd-ef02-4af8-bc9a-a2d675f1ff8e tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:55:15 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-68f42fdd-ef02-4af8-bc9a-a2d675f1ff8e tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Retype volume completed successfully.
Sep 04 15:55:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9c6a08e3-8918-40ec-883d-6264540a105a tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Acquiring lock "cinder-f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:55:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9c6a08e3-8918-40ec-883d-6264540a105a tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Lock "cinder-f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:55:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9c6a08e3-8918-40ec-883d-6264540a105a tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Acquiring lock "cinder-quobyte-f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:55:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9c6a08e3-8918-40ec-883d-6264540a105a tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Lock "cinder-quobyte-f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e" acquired by "delete_volume" :: waited 0.030s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:55:16 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[377f4ec6-1ecb-4a5b-b519-1f3bb2606531]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:55:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9c6a08e3-8918-40ec-883d-6264540a105a tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:55:16 devstack sudo[96553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e
Sep 04 15:55:16 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:55:17 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root
Sep 04 15:55:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9c6a08e3-8918-40ec-883d-6264540a105a tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e" returned: 0 in 0.395s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:55:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9c6a08e3-8918-40ec-883d-6264540a105a tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:55:17 devstack sudo[96559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e
Sep 04 15:55:17 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:55:17 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root
Sep 04 15:55:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9c6a08e3-8918-40ec-883d-6264540a105a tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e" returned: 0 in 0.284s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:55:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9c6a08e3-8918-40ec-883d-6264540a105a tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Lock "cinder-quobyte-f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e" released by "delete_volume" :: held 0.733s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:55:17 devstack cinder-volume[87504]: WARNING cinder.quota [None req-9c6a08e3-8918-40ec-883d-6264540a105a tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 04 15:55:17 devstack cinder-volume[87504]: WARNING cinder.quota [None req-9c6a08e3-8918-40ec-883d-6264540a105a tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 04 15:55:17 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-9c6a08e3-8918-40ec-883d-6264540a105a tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Created reservations ['4ca90742-d0f0-444d-bad2-68d807efef97', '67c34fd9-cf13-4898-88e2-ba03fa41dbab', 'de90fc65-0198-484b-9b2f-08ae8b77423c', '63549dfb-65bf-467e-8b73-4071ab30dc0b'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:55:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9c6a08e3-8918-40ec-883d-6264540a105a tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:55:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9c6a08e3-8918-40ec-883d-6264540a105a tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:55:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9c6a08e3-8918-40ec-883d-6264540a105a tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:55:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9c6a08e3-8918-40ec-883d-6264540a105a tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:55:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9c6a08e3-8918-40ec-883d-6264540a105a tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:55:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9c6a08e3-8918-40ec-883d-6264540a105a tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:55:17 devstack sudo[96562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:55:17 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:55:17 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root
Sep 04 15:55:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9c6a08e3-8918-40ec-883d-6264540a105a tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.365s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:55:17 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-9c6a08e3-8918-40ec-883d-6264540a105a tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:55:17 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-9c6a08e3-8918-40ec-883d-6264540a105a tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Deleted volume successfully.
Sep 04 15:55:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9c6a08e3-8918-40ec-883d-6264540a105a tempest-VolumeRetypeWithoutMigrationTest-1910005796 None] Lock "cinder-f3d8f7cc-109b-43e7-bf8e-cd90735e7c5e-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:55:18 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f86245ea-df00-4ca8-b2c3-ffd1769e827a tempest-GroupsV320Test-2044066551 None] Group tempest-GroupsV320Test-Group-1289117808: creating
Sep 04 15:55:18 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f86245ea-df00-4ca8-b2c3-ffd1769e827a tempest-GroupsV320Test-2044066551 None] Group tempest-GroupsV320Test-Group-1289117808: created successfully
Sep 04 15:55:18 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f86245ea-df00-4ca8-b2c3-ffd1769e827a tempest-GroupsV320Test-2044066551 None] Create group completed successfully.
Sep 04 15:55:20 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-fd612d4d-5f55-4c80-bf43-becdfeb01f1d tempest-GroupsV320Test-2044066551 None] Created reservations ['99c7a183-adb0-4cb8-b00a-5f7d5a54a923'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:55:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fd612d4d-5f55-4c80-bf43-becdfeb01f1d tempest-GroupsV320Test-2044066551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:55:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fd612d4d-5f55-4c80-bf43-becdfeb01f1d tempest-GroupsV320Test-2044066551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:55:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-fd612d4d-5f55-4c80-bf43-becdfeb01f1d tempest-GroupsV320Test-2044066551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:55:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-fd612d4d-5f55-4c80-bf43-becdfeb01f1d tempest-GroupsV320Test-2044066551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:55:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fd612d4d-5f55-4c80-bf43-becdfeb01f1d tempest-GroupsV320Test-2044066551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:55:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fd612d4d-5f55-4c80-bf43-becdfeb01f1d tempest-GroupsV320Test-2044066551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:55:20 devstack sudo[96572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:55:20 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:55:20 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root
Sep 04 15:55:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fd612d4d-5f55-4c80-bf43-becdfeb01f1d tempest-GroupsV320Test-2044066551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.292s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:55:20 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-fd612d4d-5f55-4c80-bf43-becdfeb01f1d tempest-GroupsV320Test-2044066551 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:55:20 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-fd612d4d-5f55-4c80-bf43-becdfeb01f1d tempest-GroupsV320Test-2044066551 None] Delete group completed successfully.
Sep 04 15:55:26 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:55:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Flow 'volume_create_manager' (8f3f7218-f5e2-4e5b-b645-5fcdccfc93f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:55:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d2bcd2-fded-4ccb-a6e3-55301c044398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:55:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d2bcd2-fded-4ccb-a6e3-55301c044398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1156791647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74038134-d3eb-476e-94c2-823fc8f81a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa21d4d006974393944a07e61261e034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:26Z,use_quota=True,user_id='88ebbd4a86c24b1489254f27ae660243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:55:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f07c381-13db-429f-9908-36c492db4411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:55:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f07c381-13db-429f-9908-36c492db4411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:55:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56af9111-4032-4e3e-b2ce-b97efe7b637a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:55:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56af9111-4032-4e3e-b2ce-b97efe7b637a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74038134-d3eb-476e-94c2-823fc8f81a63', 'volume_name': 'volume-74038134-d3eb-476e-94c2-823fc8f81a63', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:55:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d096c752-5c23-463a-aa82-0cbec59100d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:55:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d096c752-5c23-463a-aa82-0cbec59100d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:55:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1055d0d1-00ed-42e4-8c9b-5f5c07354638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:55:26 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Volume 74038134-d3eb-476e-94c2-823fc8f81a63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74038134-d3eb-476e-94c2-823fc8f81a63', 'volume_size': 1}
Sep 04 15:55:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:55:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:55:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1156791647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74038134-d3eb-476e-94c2-823fc8f81a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa21d4d006974393944a07e61261e034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:26Z,use_quota=True,user_id='88ebbd4a86c24b1489254f27ae660243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:55:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Creating volume 74038134-d3eb-476e-94c2-823fc8f81a63 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:55:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:55:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:55:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:55:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:55:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:55:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:55:26 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:55:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-74038134-d3eb-476e-94c2-823fc8f81a63 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:55:26 devstack sudo[96599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-74038134-d3eb-476e-94c2-823fc8f81a63 1073741824
Sep 04 15:55:26 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:55:26 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root
Sep 04 15:55:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-74038134-d3eb-476e-94c2-823fc8f81a63 1073741824" returned: 0 in 0.541s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:55:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-74038134-d3eb-476e-94c2-823fc8f81a63 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:55:26 devstack sudo[96604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-74038134-d3eb-476e-94c2-823fc8f81a63
Sep 04 15:55:26 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:55:27 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root
Sep 04 15:55:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-74038134-d3eb-476e-94c2-823fc8f81a63" returned: 0 in 0.349s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:55:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:55:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:55:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1055d0d1-00ed-42e4-8c9b-5f5c07354638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74038134-d3eb-476e-94c2-823fc8f81a63', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:55:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e1801fa-c49b-4557-8e52-540ce254f5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:55:27 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Volume volume-74038134-d3eb-476e-94c2-823fc8f81a63 (74038134-d3eb-476e-94c2-823fc8f81a63): created successfully
Sep 04 15:55:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e1801fa-c49b-4557-8e52-540ce254f5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:55:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Flow 'volume_create_manager' (8f3f7218-f5e2-4e5b-b645-5fcdccfc93f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:55:27 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-52cf313c-4909-4a8f-9946-c8daca9c2209 tempest-AttachVolumeNegativeTest-866639513 None] Created volume successfully.
Sep 04 15:55:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-dc1cbbc5-c460-4e44-9c7f-a56da2a5f72f req-de1f3d05-a924-4aa3-9b76-d631b50b4491 tempest-AttachVolumeNegativeTest-866639513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:55:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-dc1cbbc5-c460-4e44-9c7f-a56da2a5f72f req-de1f3d05-a924-4aa3-9b76-d631b50b4491 tempest-AttachVolumeNegativeTest-866639513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:55:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-dc1cbbc5-c460-4e44-9c7f-a56da2a5f72f req-de1f3d05-a924-4aa3-9b76-d631b50b4491 tempest-AttachVolumeNegativeTest-866639513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:55:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-dc1cbbc5-c460-4e44-9c7f-a56da2a5f72f req-de1f3d05-a924-4aa3-9b76-d631b50b4491 tempest-AttachVolumeNegativeTest-866639513 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236', 'name': 'volume-74038134-d3eb-476e-94c2-823fc8f81a63', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cdbef167-84a4-4700-b035-7a50afcda534', 'enforce_multipath': True} {{(pid=87504) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 15:55:29 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-dc1cbbc5-c460-4e44-9c7f-a56da2a5f72f req-de1f3d05-a924-4aa3-9b76-d631b50b4491 tempest-AttachVolumeNegativeTest-866639513 None] attachment_update completed successfully.
Sep 04 15:55:31 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-10f6cfc8-60e9-43cb-a295-6a6bf9bd01c1 req-6b064389-53de-4778-bb01-e2cbe9859afa tempest-AttachVolumeNegativeTest-866639513 None] Terminate volume connection completed successfully.
Sep 04 15:55:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-10f6cfc8-60e9-43cb-a295-6a6bf9bd01c1 req-6b064389-53de-4778-bb01-e2cbe9859afa tempest-AttachVolumeNegativeTest-866639513 None] Deleting attachment cdbef167-84a4-4700-b035-7a50afcda534. {{(pid=87504) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 15:55:35 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-fa67dc28-5b0a-4645-97bf-b0ce1c07ec02 req-9e04b399-b057-44ac-94b0-2f59673e9ae1 tempest-AttachVolumeTestJSON-1246579971 None] Terminate volume connection completed successfully.
Sep 04 15:55:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-fa67dc28-5b0a-4645-97bf-b0ce1c07ec02 req-9e04b399-b057-44ac-94b0-2f59673e9ae1 tempest-AttachVolumeTestJSON-1246579971 None] Deleting attachment 2f06461d-4eb7-4cde-94c0-564c78aa6fb9. {{(pid=87504) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 15:55:45 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:UPDATE=25,cinder:SELECT=26,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:55:45 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=36,cinder:UPDATE=22,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Flow 'volume_create_manager' (2931b4d2-195d-4a05-9c97-21f382ff6e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea566d31-f791-41b6-8298-82f35aaba989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea566d31-f791-41b6-8298-82f35aaba989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1000540823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea97327-2ac6-40b9-aa94-f5e57d294749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5736e80889d4ffb854f8f0dca90f80a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:49Z,use_quota=True,user_id='2a2bb25ec93143b0a9a8a32c36718c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a15d5bc-e58f-4ae1-a7b1-825e4b81995f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a15d5bc-e58f-4ae1-a7b1-825e4b81995f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1fb1dc0-0839-495f-b365-fc4c4bfcb555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1fb1dc0-0839-495f-b365-fc4c4bfcb555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cea97327-2ac6-40b9-aa94-f5e57d294749', 'volume_name': 'volume-cea97327-2ac6-40b9-aa94-f5e57d294749', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17e023ef-9cc3-4d4c-b80b-871b067dabcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17e023ef-9cc3-4d4c-b80b-871b067dabcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b3585c7-4f80-4635-acb6-961058528ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:55:48 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Volume cea97327-2ac6-40b9-aa94-f5e57d294749: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cea97327-2ac6-40b9-aa94-f5e57d294749', 'volume_size': 1}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1000540823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea97327-2ac6-40b9-aa94-f5e57d294749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5736e80889d4ffb854f8f0dca90f80a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:49Z,use_quota=True,user_id='2a2bb25ec93143b0a9a8a32c36718c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Creating volume cea97327-2ac6-40b9-aa94-f5e57d294749 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:55:48 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cea97327-2ac6-40b9-aa94-f5e57d294749 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:55:48 devstack sudo[96804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cea97327-2ac6-40b9-aa94-f5e57d294749 1073741824
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:55:48 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:55:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:55:48 devstack sudo[96806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:55:48 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:55:49 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root
Sep 04 15:55:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.507s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:55:49 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:55:49 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager._thread_info {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:55:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread count: 28 {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 15:55:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread info: [<_MainThread(MainThread, started 131673838448768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131673724603200)>, <Thread(Thread-3 (stat_writer), started daemon 131673723495936)>, <Thread(Rabbit-heartbeat, started daemon 131673723764800)>, <Thread(Thread-5 (_runner), started daemon 131673722269632)>, <Thread(Thread-7 (_runner), started daemon 131673722322112)>, <Thread(fd_logger, started daemon 131673722585024)>, <Thread(privsep_reader, started daemon 131673721593984)>, <Thread(tpool_thread_0, started daemon 131673714706112)>, <Thread(tpool_thread_1, started daemon 131673706313408)>, <Thread(tpool_thread_2, started daemon 131673697920704)>, <Thread(tpool_thread_3, started daemon 131673689528000)>, <Thread(tpool_thread_4, started daemon 131673681135296)>, <Thread(tpool_thread_5, started daemon 131673672726208)>, <Thread(tpool_thread_6, started daemon 131673664317120)>, <Thread(tpool_thread_7, started daemon 131673655908032)>, <Thread(tpool_thread_8, started daemon 131673647498944)>, <Thread(tpool_thread_9, started daemon 131673639089856)>, <Thread(tpool_thread_10, started daemon 131673630680768)>, <Thread(tpool_thread_11, started daemon 131673622271680)>, <Thread(tpool_thread_12, started daemon 131673613862592)>, <Thread(tpool_thread_13, started daemon 131673605453504)>, <Thread(tpool_thread_14, started daemon 131673597044416)>, <Thread(tpool_thread_15, started daemon 131673588635328)>, <Thread(tpool_thread_16, started daemon 131673580226240)>, <Thread(tpool_thread_17, started daemon 131673571817152)>, <Thread(tpool_thread_18, started daemon 131673563408064)>, <Thread(tpool_thread_19, started daemon 131673554998976)>] {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 15:55:49 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root
Sep 04 15:55:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cea97327-2ac6-40b9-aa94-f5e57d294749 1073741824" returned: 0 in 0.817s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:55:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cea97327-2ac6-40b9-aa94-f5e57d294749 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:55:49 devstack sudo[96814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cea97327-2ac6-40b9-aa94-f5e57d294749
Sep 04 15:55:49 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:55:50 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root
Sep 04 15:55:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cea97327-2ac6-40b9-aa94-f5e57d294749" returned: 0 in 0.445s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:55:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:55:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:55:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b3585c7-4f80-4635-acb6-961058528ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cea97327-2ac6-40b9-aa94-f5e57d294749', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:55:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7043dea8-a92e-4bc1-9a54-99993f2cb4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:55:50 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Volume volume-cea97327-2ac6-40b9-aa94-f5e57d294749 (cea97327-2ac6-40b9-aa94-f5e57d294749): created successfully
Sep 04 15:55:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7043dea8-a92e-4bc1-9a54-99993f2cb4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:55:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Flow 'volume_create_manager' (2931b4d2-195d-4a05-9c97-21f382ff6e4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:55:50 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-6f342334-c055-416f-9952-c765b9b5c387 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Created volume successfully.
Sep 04 15:55:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2314901f-3eae-453b-a5ef-f198476b03b8 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Acquiring lock "cinder-cea97327-2ac6-40b9-aa94-f5e57d294749-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:55:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2314901f-3eae-453b-a5ef-f198476b03b8 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Lock "cinder-cea97327-2ac6-40b9-aa94-f5e57d294749-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:55:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2314901f-3eae-453b-a5ef-f198476b03b8 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Acquiring lock "cinder-quobyte-cea97327-2ac6-40b9-aa94-f5e57d294749" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:55:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2314901f-3eae-453b-a5ef-f198476b03b8 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Lock "cinder-quobyte-cea97327-2ac6-40b9-aa94-f5e57d294749" acquired by "delete_volume" :: waited 0.031s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:55:51 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a28b4b-af30-4424-8c7c-6b4a7d87bf99]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:55:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2314901f-3eae-453b-a5ef-f198476b03b8 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cea97327-2ac6-40b9-aa94-f5e57d294749 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:55:51 devstack sudo[96819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cea97327-2ac6-40b9-aa94-f5e57d294749
Sep 04 15:55:51 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:55:52 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root
Sep 04 15:55:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2314901f-3eae-453b-a5ef-f198476b03b8 tempest-VolumeQuotasAdminTestJSON-1845035678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cea97327-2ac6-40b9-aa94-f5e57d294749" returned: 0 in 0.916s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:55:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2314901f-3eae-453b-a5ef-f198476b03b8 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cea97327-2ac6-40b9-aa94-f5e57d294749 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:55:52 devstack sudo[96835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cea97327-2ac6-40b9-aa94-f5e57d294749
Sep 04 15:55:52 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:55:52 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root
Sep 04 15:55:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2314901f-3eae-453b-a5ef-f198476b03b8 tempest-VolumeQuotasAdminTestJSON-1845035678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cea97327-2ac6-40b9-aa94-f5e57d294749" returned: 0 in 0.417s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:55:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2314901f-3eae-453b-a5ef-f198476b03b8 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Lock "cinder-quobyte-cea97327-2ac6-40b9-aa94-f5e57d294749" released by "delete_volume" :: held 1.424s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:55:52 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-2314901f-3eae-453b-a5ef-f198476b03b8 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Created reservations ['48741e40-c3fb-4cd6-9c85-cc2e73f3be23', 'b9a927ab-b4ff-480a-8b26-a34ad3331656', '8c2ca475-5f81-40a2-a6a7-efb9313bea5b', 'e45d073e-653c-4211-a079-21583be53c68'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:55:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2314901f-3eae-453b-a5ef-f198476b03b8 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:55:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2314901f-3eae-453b-a5ef-f198476b03b8 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:55:52 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2314901f-3eae-453b-a5ef-f198476b03b8 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:55:52 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2314901f-3eae-453b-a5ef-f198476b03b8 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:55:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2314901f-3eae-453b-a5ef-f198476b03b8 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:55:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2314901f-3eae-453b-a5ef-f198476b03b8 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:55:52 devstack sudo[96844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:55:52 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:55:53 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root
Sep 04 15:55:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2314901f-3eae-453b-a5ef-f198476b03b8 tempest-VolumeQuotasAdminTestJSON-1845035678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.380s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:55:53 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-2314901f-3eae-453b-a5ef-f198476b03b8 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:55:53 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-2314901f-3eae-453b-a5ef-f198476b03b8 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Deleted volume successfully.
Sep 04 15:55:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2314901f-3eae-453b-a5ef-f198476b03b8 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Lock "cinder-cea97327-2ac6-40b9-aa94-f5e57d294749-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:55:54 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:55:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Flow 'volume_create_manager' (cebad0ea-9a9b-4084-94f1-c5f21297f570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:55:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1accaa8a-abd7-4f3f-a42d-2430d0437437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:55:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1accaa8a-abd7-4f3f-a42d-2430d0437437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1305288623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=848343a5-4d4f-410e-9bac-dac7d50b9b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5736e80889d4ffb854f8f0dca90f80a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:54Z,use_quota=True,user_id='2a2bb25ec93143b0a9a8a32c36718c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:55:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1bbbea0-6d6b-462c-a6b6-136ec5139007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:55:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1bbbea0-6d6b-462c-a6b6-136ec5139007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:55:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61fe4fa4-290d-4c98-ac68-82626b381b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:55:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61fe4fa4-290d-4c98-ac68-82626b381b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '848343a5-4d4f-410e-9bac-dac7d50b9b36', 'volume_name': 'volume-848343a5-4d4f-410e-9bac-dac7d50b9b36', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:55:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26a28bb-1bd4-469b-99ce-38280c4684bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:55:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26a28bb-1bd4-469b-99ce-38280c4684bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:55:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43bcd2b4-2360-44f9-b7c4-057e15505466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:55:54 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Volume 848343a5-4d4f-410e-9bac-dac7d50b9b36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-848343a5-4d4f-410e-9bac-dac7d50b9b36', 'volume_size': 1}
Sep 04 15:55:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:55:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:55:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1305288623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=848343a5-4d4f-410e-9bac-dac7d50b9b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5736e80889d4ffb854f8f0dca90f80a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:54Z,use_quota=True,user_id='2a2bb25ec93143b0a9a8a32c36718c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:55:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Creating volume 848343a5-4d4f-410e-9bac-dac7d50b9b36 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:55:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:55:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:55:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:55:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:55:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:55:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:55:54 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:55:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-848343a5-4d4f-410e-9bac-dac7d50b9b36 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:55:54 devstack sudo[96848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-848343a5-4d4f-410e-9bac-dac7d50b9b36 1073741824
Sep 04 15:55:54 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:55:55 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root
Sep 04 15:55:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-848343a5-4d4f-410e-9bac-dac7d50b9b36 1073741824" returned: 0 in 0.672s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:55:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-848343a5-4d4f-410e-9bac-dac7d50b9b36 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:55:55 devstack sudo[96854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-848343a5-4d4f-410e-9bac-dac7d50b9b36
Sep 04 15:55:55 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:55:55 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root
Sep 04 15:55:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-848343a5-4d4f-410e-9bac-dac7d50b9b36" returned: 0 in 0.316s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:55:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:55:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:55:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43bcd2b4-2360-44f9-b7c4-057e15505466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-848343a5-4d4f-410e-9bac-dac7d50b9b36', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:55:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58dc59c8-ff0d-40c6-8d00-eac932bfd925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:55:55 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Volume volume-848343a5-4d4f-410e-9bac-dac7d50b9b36 (848343a5-4d4f-410e-9bac-dac7d50b9b36): created successfully
Sep 04 15:55:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58dc59c8-ff0d-40c6-8d00-eac932bfd925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:55:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Flow 'volume_create_manager' (cebad0ea-9a9b-4084-94f1-c5f21297f570) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:55:55 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-ac3d0fde-8aac-43ce-bf00-0133c5e0f0e7 tempest-VolumeQuotasAdminTestJSON-1845035678 None] Created volume successfully.
Sep 04 15:55:57 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-dc5d49b3-fb63-457a-8b88-fe4b6f1a628f tempest-VolumeQuotasAdminTestJSON-1062564436 None] Transfer volume completed successfully.
Sep 04 15:55:58 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a1b464ab-dc6f-458e-ba6d-9fbd30abebf3 tempest-VolumeQuotasAdminTestJSON-167259139 None] Acquiring lock "cinder-848343a5-4d4f-410e-9bac-dac7d50b9b36-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:55:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a1b464ab-dc6f-458e-ba6d-9fbd30abebf3 tempest-VolumeQuotasAdminTestJSON-167259139 None] Lock "cinder-848343a5-4d4f-410e-9bac-dac7d50b9b36-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:55:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a1b464ab-dc6f-458e-ba6d-9fbd30abebf3 tempest-VolumeQuotasAdminTestJSON-167259139 None] Acquiring lock "cinder-quobyte-848343a5-4d4f-410e-9bac-dac7d50b9b36" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:55:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a1b464ab-dc6f-458e-ba6d-9fbd30abebf3 tempest-VolumeQuotasAdminTestJSON-167259139 None] Lock "cinder-quobyte-848343a5-4d4f-410e-9bac-dac7d50b9b36" acquired by "delete_volume" :: waited 0.037s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:55:59 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[df552832-2132-4a73-b0a3-896ab3e699b7]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:55:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a1b464ab-dc6f-458e-ba6d-9fbd30abebf3 tempest-VolumeQuotasAdminTestJSON-167259139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-848343a5-4d4f-410e-9bac-dac7d50b9b36 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:55:59 devstack sudo[96951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-848343a5-4d4f-410e-9bac-dac7d50b9b36
Sep 04 15:55:59 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:00 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a1b464ab-dc6f-458e-ba6d-9fbd30abebf3 tempest-VolumeQuotasAdminTestJSON-167259139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-848343a5-4d4f-410e-9bac-dac7d50b9b36" returned: 0 in 0.824s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a1b464ab-dc6f-458e-ba6d-9fbd30abebf3 tempest-VolumeQuotasAdminTestJSON-167259139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-848343a5-4d4f-410e-9bac-dac7d50b9b36 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:00 devstack sudo[96965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-848343a5-4d4f-410e-9bac-dac7d50b9b36
Sep 04 15:56:00 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:00 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a1b464ab-dc6f-458e-ba6d-9fbd30abebf3 tempest-VolumeQuotasAdminTestJSON-167259139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-848343a5-4d4f-410e-9bac-dac7d50b9b36" returned: 0 in 0.609s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:00 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a1b464ab-dc6f-458e-ba6d-9fbd30abebf3 tempest-VolumeQuotasAdminTestJSON-167259139 None] Lock "cinder-quobyte-848343a5-4d4f-410e-9bac-dac7d50b9b36" released by "delete_volume" :: held 1.565s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:00 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-a1b464ab-dc6f-458e-ba6d-9fbd30abebf3 tempest-VolumeQuotasAdminTestJSON-167259139 None] Created reservations ['c8764532-2822-4b69-871e-aff80a5a2813', '68502080-cdbc-4203-9bb5-6ef03685ac86', 'e9b3a091-fac6-4ce2-9c18-c2cf0cc0e1d4', 'ac696faa-44c6-428a-9619-18db3f32384b'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:56:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a1b464ab-dc6f-458e-ba6d-9fbd30abebf3 tempest-VolumeQuotasAdminTestJSON-167259139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a1b464ab-dc6f-458e-ba6d-9fbd30abebf3 tempest-VolumeQuotasAdminTestJSON-167259139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:01 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a1b464ab-dc6f-458e-ba6d-9fbd30abebf3 tempest-VolumeQuotasAdminTestJSON-167259139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:01 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a1b464ab-dc6f-458e-ba6d-9fbd30abebf3 tempest-VolumeQuotasAdminTestJSON-167259139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a1b464ab-dc6f-458e-ba6d-9fbd30abebf3 tempest-VolumeQuotasAdminTestJSON-167259139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a1b464ab-dc6f-458e-ba6d-9fbd30abebf3 tempest-VolumeQuotasAdminTestJSON-167259139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:01 devstack sudo[96974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:56:01 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:01 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a1b464ab-dc6f-458e-ba6d-9fbd30abebf3 tempest-VolumeQuotasAdminTestJSON-167259139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.583s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:01 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-a1b464ab-dc6f-458e-ba6d-9fbd30abebf3 tempest-VolumeQuotasAdminTestJSON-167259139 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:56:01 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-a1b464ab-dc6f-458e-ba6d-9fbd30abebf3 tempest-VolumeQuotasAdminTestJSON-167259139 None] Deleted volume successfully.
Sep 04 15:56:01 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a1b464ab-dc6f-458e-ba6d-9fbd30abebf3 tempest-VolumeQuotasAdminTestJSON-167259139 None] Lock "cinder-848343a5-4d4f-410e-9bac-dac7d50b9b36-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:10 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:56:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Flow 'volume_create_manager' (dd892e11-8236-40db-be8c-f2c24dd52fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:56:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c90940d-34fc-4f1e-a63e-19ad828b8f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c90940d-34fc-4f1e-a63e-19ad828b8f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1183865787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1c3569b-a4c6-4f6c-83fc-7472aac628ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba5813a1cf64c26a581b08b81d9551c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:11Z,use_quota=True,user_id='fadb030cb2174ca98b0e2d21c2a92728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff01090-53c9-4cc6-a417-274a8224da95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff01090-53c9-4cc6-a417-274a8224da95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87c7f396-3a55-44dc-aef9-cbd3c362a2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87c7f396-3a55-44dc-aef9-cbd3c362a2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1c3569b-a4c6-4f6c-83fc-7472aac628ba', 'volume_name': 'volume-a1c3569b-a4c6-4f6c-83fc-7472aac628ba', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c787c52f-0d9f-456f-9cb6-96085055469e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c787c52f-0d9f-456f-9cb6-96085055469e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2b96ed-09c2-461d-a012-8d2c51d60828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:10 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Volume a1c3569b-a4c6-4f6c-83fc-7472aac628ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1c3569b-a4c6-4f6c-83fc-7472aac628ba', 'volume_size': 1}
Sep 04 15:56:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:10 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1183865787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1c3569b-a4c6-4f6c-83fc-7472aac628ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba5813a1cf64c26a581b08b81d9551c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:11Z,use_quota=True,user_id='fadb030cb2174ca98b0e2d21c2a92728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:56:10 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Creating volume a1c3569b-a4c6-4f6c-83fc-7472aac628ba {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:56:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:10 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:56:11 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:56:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a1c3569b-a4c6-4f6c-83fc-7472aac628ba 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:11 devstack sudo[97070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a1c3569b-a4c6-4f6c-83fc-7472aac628ba 1073741824
Sep 04 15:56:11 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:11 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a1c3569b-a4c6-4f6c-83fc-7472aac628ba 1073741824" returned: 0 in 0.932s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a1c3569b-a4c6-4f6c-83fc-7472aac628ba {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:12 devstack sudo[97076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a1c3569b-a4c6-4f6c-83fc-7472aac628ba
Sep 04 15:56:12 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:12 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a1c3569b-a4c6-4f6c-83fc-7472aac628ba" returned: 0 in 0.467s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:56:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2b96ed-09c2-461d-a012-8d2c51d60828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1c3569b-a4c6-4f6c-83fc-7472aac628ba', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f0a5c48-d098-465b-8616-8a0712d14ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:12 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Volume volume-a1c3569b-a4c6-4f6c-83fc-7472aac628ba (a1c3569b-a4c6-4f6c-83fc-7472aac628ba): created successfully
Sep 04 15:56:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f0a5c48-d098-465b-8616-8a0712d14ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Flow 'volume_create_manager' (dd892e11-8236-40db-be8c-f2c24dd52fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:56:12 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-c3099771-95b1-4171-bee2-066c30e2bfd4 tempest-VolumesActionsTest-1359162431 None] Created volume successfully.
Sep 04 15:56:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a9d959cc-3f3c-4128-84eb-b31b35173ec9 tempest-VolumesActionsTest-1359162431 None] Acquiring lock "cinder-a1c3569b-a4c6-4f6c-83fc-7472aac628ba" by "attach_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a9d959cc-3f3c-4128-84eb-b31b35173ec9 tempest-VolumesActionsTest-1359162431 None] Lock "cinder-a1c3569b-a4c6-4f6c-83fc-7472aac628ba" acquired by "attach_volume" :: waited 0.021s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:13 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-a9d959cc-3f3c-4128-84eb-b31b35173ec9 tempest-VolumesActionsTest-1359162431 None] Attaching volume a1c3569b-a4c6-4f6c-83fc-7472aac628ba to instance 0be52884-97a7-43e8-a9b0-9f3f0fc9e958 at mountpoint /dev/vdb on host None.
Sep 04 15:56:13 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-a9d959cc-3f3c-4128-84eb-b31b35173ec9 tempest-VolumesActionsTest-1359162431 None] Attach volume completed successfully.
Sep 04 15:56:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a9d959cc-3f3c-4128-84eb-b31b35173ec9 tempest-VolumesActionsTest-1359162431 None] Lock "cinder-a1c3569b-a4c6-4f6c-83fc-7472aac628ba" released by "attach_volume" :: held 0.157s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:15 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-98d663bf-898c-4da4-ac91-6db1f0869e21 tempest-VolumesActionsTest-1341054969 None] Terminate volume connection completed successfully.
Sep 04 15:56:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-98d663bf-898c-4da4-ac91-6db1f0869e21 tempest-VolumesActionsTest-1341054969 None] Acquiring lock "cinder-a1c3569b-a4c6-4f6c-83fc-7472aac628ba-detach_volume" by "detach_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-98d663bf-898c-4da4-ac91-6db1f0869e21 tempest-VolumesActionsTest-1341054969 None] Lock "cinder-a1c3569b-a4c6-4f6c-83fc-7472aac628ba-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:15 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-98d663bf-898c-4da4-ac91-6db1f0869e21 tempest-VolumesActionsTest-1341054969 None] Detaching volume a1c3569b-a4c6-4f6c-83fc-7472aac628ba from instance 0be52884-97a7-43e8-a9b0-9f3f0fc9e958.
Sep 04 15:56:15 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-98d663bf-898c-4da4-ac91-6db1f0869e21 tempest-VolumesActionsTest-1341054969 None] Detach volume completed successfully.
Sep 04 15:56:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-98d663bf-898c-4da4-ac91-6db1f0869e21 tempest-VolumesActionsTest-1341054969 None] Lock "cinder-a1c3569b-a4c6-4f6c-83fc-7472aac628ba-detach_volume" released by "detach_volume" :: held 0.146s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7a91588b-8be6-4fa6-a9fd-7aef2bb75290 tempest-VolumesActionsTest-1359162431 None] Acquiring lock "cinder-a1c3569b-a4c6-4f6c-83fc-7472aac628ba-detach_volume" by "detach_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7a91588b-8be6-4fa6-a9fd-7aef2bb75290 tempest-VolumesActionsTest-1359162431 None] Lock "cinder-a1c3569b-a4c6-4f6c-83fc-7472aac628ba-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:16 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-7a91588b-8be6-4fa6-a9fd-7aef2bb75290 tempest-VolumesActionsTest-1359162431 None] Volume detach called, but volume not attached.
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7a91588b-8be6-4fa6-a9fd-7aef2bb75290 tempest-VolumesActionsTest-1359162431 None] Lock "cinder-a1c3569b-a4c6-4f6c-83fc-7472aac628ba-detach_volume" released by "detach_volume" :: held 0.046s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Flow 'volume_create_manager' (f02e0373-eeba-4b36-93bf-3ada087cd9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f4991c-e3bc-4b00-9c1e-747bf89c3658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f4991c-e3bc-4b00-9c1e-747bf89c3658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-181444636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e16e1c6-ff9e-416b-8439-a2c86102448d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769db9a46d9f4cac8d76c5663fdb16a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:16Z,use_quota=True,user_id='dc80ecb825c34d76b1997708664bcd61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3940550-fb53-4292-adea-7b25053c0ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3940550-fb53-4292-adea-7b25053c0ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec30e78c-f867-483b-babf-f96aeeffc941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec30e78c-f867-483b-babf-f96aeeffc941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e16e1c6-ff9e-416b-8439-a2c86102448d', 'volume_name': 'volume-4e16e1c6-ff9e-416b-8439-a2c86102448d', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c17d34-7a8e-415c-9f76-bc0943b880bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c17d34-7a8e-415c-9f76-bc0943b880bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0865244-ed56-488a-b219-04d81af97070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:16 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Volume 4e16e1c6-ff9e-416b-8439-a2c86102448d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e16e1c6-ff9e-416b-8439-a2c86102448d', 'volume_size': 1}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-181444636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e16e1c6-ff9e-416b-8439-a2c86102448d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769db9a46d9f4cac8d76c5663fdb16a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:16Z,use_quota=True,user_id='dc80ecb825c34d76b1997708664bcd61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Creating volume 4e16e1c6-ff9e-416b-8439-a2c86102448d {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:56:16 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4e16e1c6-ff9e-416b-8439-a2c86102448d 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:16 devstack sudo[97133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4e16e1c6-ff9e-416b-8439-a2c86102448d 1073741824
Sep 04 15:56:16 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7bc09fe1-af75-4e80-976a-45b0543485e7 tempest-VolumesActionsTest-1359162431 None] Acquiring lock "cinder-a1c3569b-a4c6-4f6c-83fc-7472aac628ba-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7bc09fe1-af75-4e80-976a-45b0543485e7 tempest-VolumesActionsTest-1359162431 None] Lock "cinder-a1c3569b-a4c6-4f6c-83fc-7472aac628ba-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7bc09fe1-af75-4e80-976a-45b0543485e7 tempest-VolumesActionsTest-1359162431 None] Acquiring lock "cinder-quobyte-a1c3569b-a4c6-4f6c-83fc-7472aac628ba" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7bc09fe1-af75-4e80-976a-45b0543485e7 tempest-VolumesActionsTest-1359162431 None] Lock "cinder-quobyte-a1c3569b-a4c6-4f6c-83fc-7472aac628ba" acquired by "delete_volume" :: waited 0.040s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[329e0080-9a26-4d08-995b-430cab701e92]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:56:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7bc09fe1-af75-4e80-976a-45b0543485e7 tempest-VolumesActionsTest-1359162431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a1c3569b-a4c6-4f6c-83fc-7472aac628ba {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:16 devstack sudo[97138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a1c3569b-a4c6-4f6c-83fc-7472aac628ba
Sep 04 15:56:16 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:17 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4e16e1c6-ff9e-416b-8439-a2c86102448d 1073741824" returned: 0 in 0.731s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4e16e1c6-ff9e-416b-8439-a2c86102448d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:17 devstack sudo[97143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4e16e1c6-ff9e-416b-8439-a2c86102448d
Sep 04 15:56:17 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:17 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7bc09fe1-af75-4e80-976a-45b0543485e7 tempest-VolumesActionsTest-1359162431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a1c3569b-a4c6-4f6c-83fc-7472aac628ba" returned: 0 in 0.742s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7bc09fe1-af75-4e80-976a-45b0543485e7 tempest-VolumesActionsTest-1359162431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a1c3569b-a4c6-4f6c-83fc-7472aac628ba {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:17 devstack sudo[97148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a1c3569b-a4c6-4f6c-83fc-7472aac628ba
Sep 04 15:56:17 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:17 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4e16e1c6-ff9e-416b-8439-a2c86102448d" returned: 0 in 0.393s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:56:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0865244-ed56-488a-b219-04d81af97070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e16e1c6-ff9e-416b-8439-a2c86102448d', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ffbf23b-96e5-4187-bada-283c5ab38b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:17 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Volume volume-4e16e1c6-ff9e-416b-8439-a2c86102448d (4e16e1c6-ff9e-416b-8439-a2c86102448d): created successfully
Sep 04 15:56:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ffbf23b-96e5-4187-bada-283c5ab38b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Flow 'volume_create_manager' (f02e0373-eeba-4b36-93bf-3ada087cd9e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:56:17 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-748bed12-f222-47a1-89c0-58505a158d40 tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Created volume successfully.
Sep 04 15:56:17 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7bc09fe1-af75-4e80-976a-45b0543485e7 tempest-VolumesActionsTest-1359162431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a1c3569b-a4c6-4f6c-83fc-7472aac628ba" returned: 0 in 0.396s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7bc09fe1-af75-4e80-976a-45b0543485e7 tempest-VolumesActionsTest-1359162431 None] Lock "cinder-quobyte-a1c3569b-a4c6-4f6c-83fc-7472aac628ba" released by "delete_volume" :: held 1.198s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:18 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-7bc09fe1-af75-4e80-976a-45b0543485e7 tempest-VolumesActionsTest-1359162431 None] Created reservations ['0b06b73e-b74d-4256-98e0-f3b04c30fdc0', 'd66d9cc6-22ce-492b-ae2b-43d23017ea87', '244e7328-2386-41d1-ba50-b733b1996152', '02d09780-77cc-42ff-aaa7-b09653ce507a'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:56:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7bc09fe1-af75-4e80-976a-45b0543485e7 tempest-VolumesActionsTest-1359162431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7bc09fe1-af75-4e80-976a-45b0543485e7 tempest-VolumesActionsTest-1359162431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:18 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7bc09fe1-af75-4e80-976a-45b0543485e7 tempest-VolumesActionsTest-1359162431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:18 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7bc09fe1-af75-4e80-976a-45b0543485e7 tempest-VolumesActionsTest-1359162431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7bc09fe1-af75-4e80-976a-45b0543485e7 tempest-VolumesActionsTest-1359162431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7bc09fe1-af75-4e80-976a-45b0543485e7 tempest-VolumesActionsTest-1359162431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:18 devstack sudo[97152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:56:18 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:18 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7bc09fe1-af75-4e80-976a-45b0543485e7 tempest-VolumesActionsTest-1359162431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.291s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:18 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-7bc09fe1-af75-4e80-976a-45b0543485e7 tempest-VolumesActionsTest-1359162431 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:56:18 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-7bc09fe1-af75-4e80-976a-45b0543485e7 tempest-VolumesActionsTest-1359162431 None] Deleted volume successfully.
Sep 04 15:56:18 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7bc09fe1-af75-4e80-976a-45b0543485e7 tempest-VolumesActionsTest-1359162431 None] Lock "cinder-a1c3569b-a4c6-4f6c-83fc-7472aac628ba-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-606c7afe-77a0-4a42-85a8-bf779b6fa79b tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Acquiring lock "cinder-4e16e1c6-ff9e-416b-8439-a2c86102448d-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-606c7afe-77a0-4a42-85a8-bf779b6fa79b tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Lock "cinder-4e16e1c6-ff9e-416b-8439-a2c86102448d-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-606c7afe-77a0-4a42-85a8-bf779b6fa79b tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Acquiring lock "cinder-quobyte-4e16e1c6-ff9e-416b-8439-a2c86102448d" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-606c7afe-77a0-4a42-85a8-bf779b6fa79b tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Lock "cinder-quobyte-4e16e1c6-ff9e-416b-8439-a2c86102448d" acquired by "delete_volume" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:20 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a940f942-a2df-4a16-871c-f4ee6057624a]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:56:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-606c7afe-77a0-4a42-85a8-bf779b6fa79b tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4e16e1c6-ff9e-416b-8439-a2c86102448d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:20 devstack sudo[97184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4e16e1c6-ff9e-416b-8439-a2c86102448d
Sep 04 15:56:20 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:20 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-606c7afe-77a0-4a42-85a8-bf779b6fa79b tempest-VolumeQuotasNegativeTestJSON-1134444365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4e16e1c6-ff9e-416b-8439-a2c86102448d" returned: 0 in 0.468s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-606c7afe-77a0-4a42-85a8-bf779b6fa79b tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4e16e1c6-ff9e-416b-8439-a2c86102448d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:20 devstack sudo[97190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4e16e1c6-ff9e-416b-8439-a2c86102448d
Sep 04 15:56:20 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:21 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-606c7afe-77a0-4a42-85a8-bf779b6fa79b tempest-VolumeQuotasNegativeTestJSON-1134444365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4e16e1c6-ff9e-416b-8439-a2c86102448d" returned: 0 in 0.370s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-606c7afe-77a0-4a42-85a8-bf779b6fa79b tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Lock "cinder-quobyte-4e16e1c6-ff9e-416b-8439-a2c86102448d" released by "delete_volume" :: held 0.907s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:21 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-606c7afe-77a0-4a42-85a8-bf779b6fa79b tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Created reservations ['cd4f9663-5091-436c-ba0a-cc557f8d2c97', 'e66d45f3-6355-4703-8cdf-a80f556e1d75', 'd73c8880-4165-4723-bb65-dda9fc23136e', '2be077d3-d0aa-4445-9766-bf8211895fc9'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:56:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-606c7afe-77a0-4a42-85a8-bf779b6fa79b tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-606c7afe-77a0-4a42-85a8-bf779b6fa79b tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-606c7afe-77a0-4a42-85a8-bf779b6fa79b tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-606c7afe-77a0-4a42-85a8-bf779b6fa79b tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-606c7afe-77a0-4a42-85a8-bf779b6fa79b tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-606c7afe-77a0-4a42-85a8-bf779b6fa79b tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:21 devstack sudo[97196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:56:21 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:21 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-606c7afe-77a0-4a42-85a8-bf779b6fa79b tempest-VolumeQuotasNegativeTestJSON-1134444365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.327s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:21 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-606c7afe-77a0-4a42-85a8-bf779b6fa79b tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:56:21 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-606c7afe-77a0-4a42-85a8-bf779b6fa79b tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Deleted volume successfully.
Sep 04 15:56:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-606c7afe-77a0-4a42-85a8-bf779b6fa79b tempest-VolumeQuotasNegativeTestJSON-1134444365 None] Lock "cinder-4e16e1c6-ff9e-416b-8439-a2c86102448d-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:22 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:56:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Flow 'volume_create_manager' (53ad8f73-cfc5-4f22-b98a-4ae9eed376a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:56:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f6b587-f172-4384-b437-761091f78840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f6b587-f172-4384-b437-761091f78840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1067193387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c160ce0-8858-4c81-8988-c0c831563c7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba5813a1cf64c26a581b08b81d9551c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:23Z,use_quota=True,user_id='fadb030cb2174ca98b0e2d21c2a92728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015986b3-78a3-4787-994f-eb5734d9b73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015986b3-78a3-4787-994f-eb5734d9b73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708362f3-2319-4e70-8669-e0878ff79a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708362f3-2319-4e70-8669-e0878ff79a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c160ce0-8858-4c81-8988-c0c831563c7f', 'volume_name': 'volume-5c160ce0-8858-4c81-8988-c0c831563c7f', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6313a5f-44e9-45b4-9fe8-3886412b1486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6313a5f-44e9-45b4-9fe8-3886412b1486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49423800-a68a-4a70-b635-066c772ad0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:23 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Volume 5c160ce0-8858-4c81-8988-c0c831563c7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c160ce0-8858-4c81-8988-c0c831563c7f', 'volume_size': 1}
Sep 04 15:56:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1067193387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c160ce0-8858-4c81-8988-c0c831563c7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba5813a1cf64c26a581b08b81d9551c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:23Z,use_quota=True,user_id='fadb030cb2174ca98b0e2d21c2a92728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:56:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Creating volume 5c160ce0-8858-4c81-8988-c0c831563c7f {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:56:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:56:23 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:56:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5c160ce0-8858-4c81-8988-c0c831563c7f 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:23 devstack sudo[97199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5c160ce0-8858-4c81-8988-c0c831563c7f 1073741824
Sep 04 15:56:23 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:23 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5c160ce0-8858-4c81-8988-c0c831563c7f 1073741824" returned: 0 in 0.671s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5c160ce0-8858-4c81-8988-c0c831563c7f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:23 devstack sudo[97205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5c160ce0-8858-4c81-8988-c0c831563c7f
Sep 04 15:56:23 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:24 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5c160ce0-8858-4c81-8988-c0c831563c7f" returned: 0 in 0.327s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:24 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:56:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49423800-a68a-4a70-b635-066c772ad0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c160ce0-8858-4c81-8988-c0c831563c7f', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5b8680-91aa-4995-ba59-90bf41e4f9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:24 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Volume volume-5c160ce0-8858-4c81-8988-c0c831563c7f (5c160ce0-8858-4c81-8988-c0c831563c7f): created successfully
Sep 04 15:56:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5b8680-91aa-4995-ba59-90bf41e4f9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Flow 'volume_create_manager' (53ad8f73-cfc5-4f22-b98a-4ae9eed376a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:56:24 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-7886458c-486d-49b9-899f-d242be49bdce tempest-VolumesActionsTest-1359162431 None] Created volume successfully.
Sep 04 15:56:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-954bb3cc-9e6c-490f-bc1f-dba083ee87a4 tempest-VolumesActionsTest-1341054969 None] Acquiring lock "cinder-5c160ce0-8858-4c81-8988-c0c831563c7f-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-954bb3cc-9e6c-490f-bc1f-dba083ee87a4 tempest-VolumesActionsTest-1341054969 None] Lock "cinder-5c160ce0-8858-4c81-8988-c0c831563c7f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-954bb3cc-9e6c-490f-bc1f-dba083ee87a4 tempest-VolumesActionsTest-1341054969 None] Acquiring lock "cinder-quobyte-5c160ce0-8858-4c81-8988-c0c831563c7f" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-954bb3cc-9e6c-490f-bc1f-dba083ee87a4 tempest-VolumesActionsTest-1341054969 None] Lock "cinder-quobyte-5c160ce0-8858-4c81-8988-c0c831563c7f" acquired by "delete_volume" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:25 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69203ca-e0b3-4d13-917d-02983699e8fc]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:56:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-954bb3cc-9e6c-490f-bc1f-dba083ee87a4 tempest-VolumesActionsTest-1341054969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5c160ce0-8858-4c81-8988-c0c831563c7f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:25 devstack sudo[97214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5c160ce0-8858-4c81-8988-c0c831563c7f
Sep 04 15:56:25 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:25 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:56:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Flow 'volume_create_manager' (508a00b9-0d09-4b99-ac94-a2a410b00440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:56:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf3e80c-da02-40f2-b783-407088bdc78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf3e80c-da02-40f2-b783-407088bdc78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-580876706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f69c0d3-8afa-4671-9117-0b9b5e7cff3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa21d4d006974393944a07e61261e034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:26Z,use_quota=True,user_id='88ebbd4a86c24b1489254f27ae660243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06206bed-5830-4d43-89b7-4c918c02ad41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06206bed-5830-4d43-89b7-4c918c02ad41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f1dc3e-0281-46d3-8676-adecc660a1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f1dc3e-0281-46d3-8676-adecc660a1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f69c0d3-8afa-4671-9117-0b9b5e7cff3c', 'volume_name': 'volume-1f69c0d3-8afa-4671-9117-0b9b5e7cff3c', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:26 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e2c76b-3c61-4b2d-9815-1788e48c21f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e2c76b-3c61-4b2d-9815-1788e48c21f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b5b6ba-c5a8-4a0c-88ee-2100bb514ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:26 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Volume 1f69c0d3-8afa-4671-9117-0b9b5e7cff3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f69c0d3-8afa-4671-9117-0b9b5e7cff3c', 'volume_size': 1}
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-580876706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f69c0d3-8afa-4671-9117-0b9b5e7cff3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa21d4d006974393944a07e61261e034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:26Z,use_quota=True,user_id='88ebbd4a86c24b1489254f27ae660243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Creating volume 1f69c0d3-8afa-4671-9117-0b9b5e7cff3c {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:56:26 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1f69c0d3-8afa-4671-9117-0b9b5e7cff3c 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-954bb3cc-9e6c-490f-bc1f-dba083ee87a4 tempest-VolumesActionsTest-1341054969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5c160ce0-8858-4c81-8988-c0c831563c7f" returned: 0 in 0.600s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-954bb3cc-9e6c-490f-bc1f-dba083ee87a4 tempest-VolumesActionsTest-1341054969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5c160ce0-8858-4c81-8988-c0c831563c7f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:26 devstack sudo[97220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1f69c0d3-8afa-4671-9117-0b9b5e7cff3c 1073741824
Sep 04 15:56:26 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:26 devstack sudo[97223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5c160ce0-8858-4c81-8988-c0c831563c7f
Sep 04 15:56:26 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:26 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-954bb3cc-9e6c-490f-bc1f-dba083ee87a4 tempest-VolumesActionsTest-1341054969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5c160ce0-8858-4c81-8988-c0c831563c7f" returned: 0 in 0.554s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-954bb3cc-9e6c-490f-bc1f-dba083ee87a4 tempest-VolumesActionsTest-1341054969 None] Lock "cinder-quobyte-5c160ce0-8858-4c81-8988-c0c831563c7f" released by "delete_volume" :: held 1.239s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-954bb3cc-9e6c-490f-bc1f-dba083ee87a4 tempest-VolumesActionsTest-1341054969 None] Created reservations ['e76e740f-6b1a-4fb2-a0ef-a7ee9d87c858', '5c06f63f-49a8-46db-8d4b-69ccd54c3ac3', 'e6f525f0-cc3d-403b-8886-8113d4c4f2c3', '7f59e629-e291-4984-9d79-4b076533b92e'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:56:26 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1f69c0d3-8afa-4671-9117-0b9b5e7cff3c 1073741824" returned: 0 in 0.754s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1f69c0d3-8afa-4671-9117-0b9b5e7cff3c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:26 devstack sudo[97247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1f69c0d3-8afa-4671-9117-0b9b5e7cff3c
Sep 04 15:56:26 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-954bb3cc-9e6c-490f-bc1f-dba083ee87a4 tempest-VolumesActionsTest-1341054969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-954bb3cc-9e6c-490f-bc1f-dba083ee87a4 tempest-VolumesActionsTest-1341054969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-954bb3cc-9e6c-490f-bc1f-dba083ee87a4 tempest-VolumesActionsTest-1341054969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-954bb3cc-9e6c-490f-bc1f-dba083ee87a4 tempest-VolumesActionsTest-1341054969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-954bb3cc-9e6c-490f-bc1f-dba083ee87a4 tempest-VolumesActionsTest-1341054969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-954bb3cc-9e6c-490f-bc1f-dba083ee87a4 tempest-VolumesActionsTest-1341054969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:26 devstack sudo[97249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:56:26 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:27 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1f69c0d3-8afa-4671-9117-0b9b5e7cff3c" returned: 0 in 0.320s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:56:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b5b6ba-c5a8-4a0c-88ee-2100bb514ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f69c0d3-8afa-4671-9117-0b9b5e7cff3c', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ceee8d5-dec4-45e0-826f-4b628ec2d533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:27 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Volume volume-1f69c0d3-8afa-4671-9117-0b9b5e7cff3c (1f69c0d3-8afa-4671-9117-0b9b5e7cff3c): created successfully
Sep 04 15:56:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ceee8d5-dec4-45e0-826f-4b628ec2d533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Flow 'volume_create_manager' (508a00b9-0d09-4b99-ac94-a2a410b00440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:56:27 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-934373d7-dd29-42fe-9f75-70313c76769d tempest-AttachVolumeNegativeTest-866639513 None] Created volume successfully.
Sep 04 15:56:27 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-954bb3cc-9e6c-490f-bc1f-dba083ee87a4 tempest-VolumesActionsTest-1341054969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.397s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:27 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-954bb3cc-9e6c-490f-bc1f-dba083ee87a4 tempest-VolumesActionsTest-1341054969 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:56:27 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-954bb3cc-9e6c-490f-bc1f-dba083ee87a4 tempest-VolumesActionsTest-1341054969 None] Deleted volume successfully.
Sep 04 15:56:27 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-954bb3cc-9e6c-490f-bc1f-dba083ee87a4 tempest-VolumesActionsTest-1341054969 None] Lock "cinder-5c160ce0-8858-4c81-8988-c0c831563c7f-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:28 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:56:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Flow 'volume_create_manager' (95b6eb37-12c1-4939-b2db-86c0ac354d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:56:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e560bd88-d530-4899-84b4-f3ad0ebd414b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e560bd88-d530-4899-84b4-f3ad0ebd414b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1385159530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c02faa0b-d448-4118-8ee3-445ba5746d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba5813a1cf64c26a581b08b81d9551c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:28Z,use_quota=True,user_id='fadb030cb2174ca98b0e2d21c2a92728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294b6cd1-c1c0-40ec-a68e-158875d08318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294b6cd1-c1c0-40ec-a68e-158875d08318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f370ea8-b5a4-42e6-b42d-e0726387951d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f370ea8-b5a4-42e6-b42d-e0726387951d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c02faa0b-d448-4118-8ee3-445ba5746d15', 'volume_name': 'volume-c02faa0b-d448-4118-8ee3-445ba5746d15', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334b6e2a-5bbb-481e-a410-d2f8acae0e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334b6e2a-5bbb-481e-a410-d2f8acae0e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff32990b-eae4-4953-97f3-ccbf35f50877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:28 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Volume c02faa0b-d448-4118-8ee3-445ba5746d15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c02faa0b-d448-4118-8ee3-445ba5746d15', 'volume_size': 1}
Sep 04 15:56:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1385159530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c02faa0b-d448-4118-8ee3-445ba5746d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba5813a1cf64c26a581b08b81d9551c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:28Z,use_quota=True,user_id='fadb030cb2174ca98b0e2d21c2a92728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:56:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Creating volume c02faa0b-d448-4118-8ee3-445ba5746d15 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:56:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:56:28 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:56:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c02faa0b-d448-4118-8ee3-445ba5746d15 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:28 devstack sudo[97256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c02faa0b-d448-4118-8ee3-445ba5746d15 1073741824
Sep 04 15:56:28 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-edbbd997-4f64-4f58-9739-b02bf97a125c req-fd21207c-a953-4a43-b8b4-80704640ae29 tempest-AttachVolumeNegativeTest-866639513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:29 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c02faa0b-d448-4118-8ee3-445ba5746d15 1073741824" returned: 0 in 0.718s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c02faa0b-d448-4118-8ee3-445ba5746d15 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:29 devstack sudo[97270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c02faa0b-d448-4118-8ee3-445ba5746d15
Sep 04 15:56:29 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:29 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c02faa0b-d448-4118-8ee3-445ba5746d15" returned: 0 in 0.328s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:29 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:56:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-edbbd997-4f64-4f58-9739-b02bf97a125c req-fd21207c-a953-4a43-b8b4-80704640ae29 tempest-AttachVolumeNegativeTest-866639513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.636s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-edbbd997-4f64-4f58-9739-b02bf97a125c req-fd21207c-a953-4a43-b8b4-80704640ae29 tempest-AttachVolumeNegativeTest-866639513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff32990b-eae4-4953-97f3-ccbf35f50877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c02faa0b-d448-4118-8ee3-445ba5746d15', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (801609d4-f38e-4600-906f-dc88f9c3874d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:29 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Volume volume-c02faa0b-d448-4118-8ee3-445ba5746d15 (c02faa0b-d448-4118-8ee3-445ba5746d15): created successfully
Sep 04 15:56:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (801609d4-f38e-4600-906f-dc88f9c3874d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Flow 'volume_create_manager' (95b6eb37-12c1-4939-b2db-86c0ac354d8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:56:29 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-175ab47d-c0df-4185-8f56-a05798ea0c9e tempest-VolumesActionsTest-1359162431 None] Created volume successfully.
Sep 04 15:56:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-edbbd997-4f64-4f58-9739-b02bf97a125c req-fd21207c-a953-4a43-b8b4-80704640ae29 tempest-AttachVolumeNegativeTest-866639513 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236', 'name': 'volume-1f69c0d3-8afa-4671-9117-0b9b5e7cff3c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7cce3a2-2ba6-48e2-8e28-d20118d70f01', 'enforce_multipath': True} {{(pid=87504) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 15:56:29 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-edbbd997-4f64-4f58-9739-b02bf97a125c req-fd21207c-a953-4a43-b8b4-80704640ae29 tempest-AttachVolumeNegativeTest-866639513 None] attachment_update completed successfully.
Sep 04 15:56:30 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1d43af09-6213-41e1-960a-89b20731f5e9 tempest-VolumesActionsTest-1341054969 None] Acquiring lock "cinder-c02faa0b-d448-4118-8ee3-445ba5746d15-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:30 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1d43af09-6213-41e1-960a-89b20731f5e9 tempest-VolumesActionsTest-1341054969 None] Lock "cinder-c02faa0b-d448-4118-8ee3-445ba5746d15-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:31 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1d43af09-6213-41e1-960a-89b20731f5e9 tempest-VolumesActionsTest-1341054969 None] Acquiring lock "cinder-quobyte-c02faa0b-d448-4118-8ee3-445ba5746d15" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:31 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1d43af09-6213-41e1-960a-89b20731f5e9 tempest-VolumesActionsTest-1341054969 None] Lock "cinder-quobyte-c02faa0b-d448-4118-8ee3-445ba5746d15" acquired by "delete_volume" :: waited 0.029s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:31 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98afc7e-2486-4bff-bcef-2044fe961397]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:56:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1d43af09-6213-41e1-960a-89b20731f5e9 tempest-VolumesActionsTest-1341054969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c02faa0b-d448-4118-8ee3-445ba5746d15 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:31 devstack sudo[97718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c02faa0b-d448-4118-8ee3-445ba5746d15
Sep 04 15:56:31 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:31 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1d43af09-6213-41e1-960a-89b20731f5e9 tempest-VolumesActionsTest-1341054969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c02faa0b-d448-4118-8ee3-445ba5746d15" returned: 0 in 0.615s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1d43af09-6213-41e1-960a-89b20731f5e9 tempest-VolumesActionsTest-1341054969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c02faa0b-d448-4118-8ee3-445ba5746d15 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:31 devstack sudo[97728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c02faa0b-d448-4118-8ee3-445ba5746d15
Sep 04 15:56:31 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:32 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1d43af09-6213-41e1-960a-89b20731f5e9 tempest-VolumesActionsTest-1341054969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c02faa0b-d448-4118-8ee3-445ba5746d15" returned: 0 in 0.426s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:32 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1d43af09-6213-41e1-960a-89b20731f5e9 tempest-VolumesActionsTest-1341054969 None] Lock "cinder-quobyte-c02faa0b-d448-4118-8ee3-445ba5746d15" released by "delete_volume" :: held 1.129s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:32 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-1d43af09-6213-41e1-960a-89b20731f5e9 tempest-VolumesActionsTest-1341054969 None] Created reservations ['66c2d75f-28a1-48d0-b45e-d40431ead295', '718e7d06-c60f-4f6c-aa2d-bb6d5c8c605d', 'f7fccfa1-53b6-4007-8d95-c5f56b3ce5a0', '6af2e58c-16d0-4781-8a08-ba08e9ec30b0'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:56:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1d43af09-6213-41e1-960a-89b20731f5e9 tempest-VolumesActionsTest-1341054969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1d43af09-6213-41e1-960a-89b20731f5e9 tempest-VolumesActionsTest-1341054969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:32 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1d43af09-6213-41e1-960a-89b20731f5e9 tempest-VolumesActionsTest-1341054969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:32 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1d43af09-6213-41e1-960a-89b20731f5e9 tempest-VolumesActionsTest-1341054969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1d43af09-6213-41e1-960a-89b20731f5e9 tempest-VolumesActionsTest-1341054969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1d43af09-6213-41e1-960a-89b20731f5e9 tempest-VolumesActionsTest-1341054969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:32 devstack sudo[97731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:56:32 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:32 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1d43af09-6213-41e1-960a-89b20731f5e9 tempest-VolumesActionsTest-1341054969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.581s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:32 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-1d43af09-6213-41e1-960a-89b20731f5e9 tempest-VolumesActionsTest-1341054969 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:56:33 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-1d43af09-6213-41e1-960a-89b20731f5e9 tempest-VolumesActionsTest-1341054969 None] Deleted volume successfully.
Sep 04 15:56:33 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1d43af09-6213-41e1-960a-89b20731f5e9 tempest-VolumesActionsTest-1341054969 None] Lock "cinder-c02faa0b-d448-4118-8ee3-445ba5746d15-delete_volume" released by "delete_volume" :: held 2.142s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:34 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-c30e2321-f62a-46f5-a6be-e8299845bba9 req-47e800fd-2baf-4853-a30f-14ddcd54faba tempest-AttachVolumeNegativeTest-866639513 None] Terminate volume connection completed successfully.
Sep 04 15:56:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-c30e2321-f62a-46f5-a6be-e8299845bba9 req-47e800fd-2baf-4853-a30f-14ddcd54faba tempest-AttachVolumeNegativeTest-866639513 None] Deleting attachment c7cce3a2-2ba6-48e2-8e28-d20118d70f01. {{(pid=87504) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 15:56:34 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:56:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Flow 'volume_create_manager' (a30beec5-a12d-42d6-b3cb-f01a321047b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:56:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (652a354e-a89f-409e-9ac6-155739e78e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (652a354e-a89f-409e-9ac6-155739e78e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-697263299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f6b45e-2364-4f90-afd8-5b470b85cde2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba5813a1cf64c26a581b08b81d9551c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:34Z,use_quota=True,user_id='fadb030cb2174ca98b0e2d21c2a92728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c98d9ea-12aa-425f-8855-3b8dd6f701fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c98d9ea-12aa-425f-8855-3b8dd6f701fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a5eaf9-a7b3-40a8-97ee-dad59d941785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a5eaf9-a7b3-40a8-97ee-dad59d941785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13f6b45e-2364-4f90-afd8-5b470b85cde2', 'volume_name': 'volume-13f6b45e-2364-4f90-afd8-5b470b85cde2', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f93b669-fe30-4e0a-81f0-accddcdd291d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f93b669-fe30-4e0a-81f0-accddcdd291d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96961bf5-392a-43f8-a753-a4cc0d612638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:34 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Volume 13f6b45e-2364-4f90-afd8-5b470b85cde2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13f6b45e-2364-4f90-afd8-5b470b85cde2', 'volume_size': 1}
Sep 04 15:56:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-697263299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f6b45e-2364-4f90-afd8-5b470b85cde2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba5813a1cf64c26a581b08b81d9551c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:34Z,use_quota=True,user_id='fadb030cb2174ca98b0e2d21c2a92728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:56:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Creating volume 13f6b45e-2364-4f90-afd8-5b470b85cde2 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:56:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:56:34 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:56:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-13f6b45e-2364-4f90-afd8-5b470b85cde2 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:34 devstack sudo[97779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-13f6b45e-2364-4f90-afd8-5b470b85cde2 1073741824
Sep 04 15:56:34 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:35 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-13f6b45e-2364-4f90-afd8-5b470b85cde2 1073741824" returned: 0 in 0.879s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-13f6b45e-2364-4f90-afd8-5b470b85cde2 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:36 devstack sudo[97795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-13f6b45e-2364-4f90-afd8-5b470b85cde2
Sep 04 15:56:36 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:36 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-13f6b45e-2364-4f90-afd8-5b470b85cde2" returned: 0 in 0.638s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:36 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:56:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:36 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96961bf5-392a-43f8-a753-a4cc0d612638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13f6b45e-2364-4f90-afd8-5b470b85cde2', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:36 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524e8d93-47fa-4ef3-99e1-875fe458458c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:36 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Volume volume-13f6b45e-2364-4f90-afd8-5b470b85cde2 (13f6b45e-2364-4f90-afd8-5b470b85cde2): created successfully
Sep 04 15:56:36 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524e8d93-47fa-4ef3-99e1-875fe458458c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:36 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Flow 'volume_create_manager' (a30beec5-a12d-42d6-b3cb-f01a321047b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:56:36 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-99677f26-1acf-4535-bc02-e5d2bf1918ea tempest-VolumesActionsTest-1359162431 None] Created volume successfully.
Sep 04 15:56:38 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e04dc27e-b2fa-4ce3-bf6f-b41fae3e039c tempest-VolumesActionsTest-1341054969 None] Acquiring lock "cinder-13f6b45e-2364-4f90-afd8-5b470b85cde2-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:38 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e04dc27e-b2fa-4ce3-bf6f-b41fae3e039c tempest-VolumesActionsTest-1341054969 None] Lock "cinder-13f6b45e-2364-4f90-afd8-5b470b85cde2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:38 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e04dc27e-b2fa-4ce3-bf6f-b41fae3e039c tempest-VolumesActionsTest-1341054969 None] Acquiring lock "cinder-quobyte-13f6b45e-2364-4f90-afd8-5b470b85cde2" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:38 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e04dc27e-b2fa-4ce3-bf6f-b41fae3e039c tempest-VolumesActionsTest-1341054969 None] Lock "cinder-quobyte-13f6b45e-2364-4f90-afd8-5b470b85cde2" acquired by "delete_volume" :: waited 0.017s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:38 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e4c594-21d6-4206-af4d-cd3cc88c3d32]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:56:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e04dc27e-b2fa-4ce3-bf6f-b41fae3e039c tempest-VolumesActionsTest-1341054969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-13f6b45e-2364-4f90-afd8-5b470b85cde2 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:38 devstack sudo[97813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-13f6b45e-2364-4f90-afd8-5b470b85cde2
Sep 04 15:56:38 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:38 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e04dc27e-b2fa-4ce3-bf6f-b41fae3e039c tempest-VolumesActionsTest-1341054969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-13f6b45e-2364-4f90-afd8-5b470b85cde2" returned: 0 in 0.538s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e04dc27e-b2fa-4ce3-bf6f-b41fae3e039c tempest-VolumesActionsTest-1341054969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-13f6b45e-2364-4f90-afd8-5b470b85cde2 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:38 devstack sudo[97819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-13f6b45e-2364-4f90-afd8-5b470b85cde2
Sep 04 15:56:38 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:39 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e04dc27e-b2fa-4ce3-bf6f-b41fae3e039c tempest-VolumesActionsTest-1341054969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-13f6b45e-2364-4f90-afd8-5b470b85cde2" returned: 0 in 0.297s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:39 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e04dc27e-b2fa-4ce3-bf6f-b41fae3e039c tempest-VolumesActionsTest-1341054969 None] Lock "cinder-quobyte-13f6b45e-2364-4f90-afd8-5b470b85cde2" released by "delete_volume" :: held 0.907s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:39 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-e04dc27e-b2fa-4ce3-bf6f-b41fae3e039c tempest-VolumesActionsTest-1341054969 None] Created reservations ['52e142f7-ba82-419d-a1c7-881a088fa4df', '69832df7-e188-4e49-931b-0411df5a54e6', '99592439-cfd8-405b-97c5-7efe8569ef8c', '1796eba2-bb0f-40d2-a9d7-107c46b32621'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:56:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e04dc27e-b2fa-4ce3-bf6f-b41fae3e039c tempest-VolumesActionsTest-1341054969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e04dc27e-b2fa-4ce3-bf6f-b41fae3e039c tempest-VolumesActionsTest-1341054969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:39 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e04dc27e-b2fa-4ce3-bf6f-b41fae3e039c tempest-VolumesActionsTest-1341054969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:39 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e04dc27e-b2fa-4ce3-bf6f-b41fae3e039c tempest-VolumesActionsTest-1341054969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e04dc27e-b2fa-4ce3-bf6f-b41fae3e039c tempest-VolumesActionsTest-1341054969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e04dc27e-b2fa-4ce3-bf6f-b41fae3e039c tempest-VolumesActionsTest-1341054969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:39 devstack sudo[97822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:56:39 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:39 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e04dc27e-b2fa-4ce3-bf6f-b41fae3e039c tempest-VolumesActionsTest-1341054969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.612s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-e04dc27e-b2fa-4ce3-bf6f-b41fae3e039c tempest-VolumesActionsTest-1341054969 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:56:40 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e04dc27e-b2fa-4ce3-bf6f-b41fae3e039c tempest-VolumesActionsTest-1341054969 None] Deleted volume successfully.
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e04dc27e-b2fa-4ce3-bf6f-b41fae3e039c tempest-VolumesActionsTest-1341054969 None] Lock "cinder-13f6b45e-2364-4f90-afd8-5b470b85cde2-delete_volume" released by "delete_volume" :: held 1.908s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Flow 'volume_create_manager' (d1bc7260-7642-4eb1-8cf0-2ed143c2e84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77dcfe9a-96a7-4dfb-ab4b-1213f57dc7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77dcfe9a-96a7-4dfb-ab4b-1213f57dc7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1563931452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01dc1daa-608a-4bcb-a671-6935dc9372d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba5813a1cf64c26a581b08b81d9551c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:40Z,use_quota=True,user_id='fadb030cb2174ca98b0e2d21c2a92728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab77b12b-f882-47c3-97df-38c4fcc28cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab77b12b-f882-47c3-97df-38c4fcc28cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a40955f-7161-4c11-b66a-d309236c4540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a40955f-7161-4c11-b66a-d309236c4540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01dc1daa-608a-4bcb-a671-6935dc9372d1', 'volume_name': 'volume-01dc1daa-608a-4bcb-a671-6935dc9372d1', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ebfb15-c441-4593-91d1-788d28f998df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ebfb15-c441-4593-91d1-788d28f998df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36dd8a03-8fb3-462d-850d-0110afc4a0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:40 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Volume 01dc1daa-608a-4bcb-a671-6935dc9372d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01dc1daa-608a-4bcb-a671-6935dc9372d1', 'volume_size': 1}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1563931452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01dc1daa-608a-4bcb-a671-6935dc9372d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba5813a1cf64c26a581b08b81d9551c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:40Z,use_quota=True,user_id='fadb030cb2174ca98b0e2d21c2a92728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Creating volume 01dc1daa-608a-4bcb-a671-6935dc9372d1 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:56:40 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-01dc1daa-608a-4bcb-a671-6935dc9372d1 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:40 devstack sudo[97825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-01dc1daa-608a-4bcb-a671-6935dc9372d1 1073741824
Sep 04 15:56:40 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f6d262b7-34af-4e22-9f46-594003bdb688 tempest-AttachVolumeNegativeTest-866639513 None] Acquiring lock "cinder-1f69c0d3-8afa-4671-9117-0b9b5e7cff3c-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f6d262b7-34af-4e22-9f46-594003bdb688 tempest-AttachVolumeNegativeTest-866639513 None] Lock "cinder-1f69c0d3-8afa-4671-9117-0b9b5e7cff3c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f6d262b7-34af-4e22-9f46-594003bdb688 tempest-AttachVolumeNegativeTest-866639513 None] Acquiring lock "cinder-quobyte-1f69c0d3-8afa-4671-9117-0b9b5e7cff3c" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f6d262b7-34af-4e22-9f46-594003bdb688 tempest-AttachVolumeNegativeTest-866639513 None] Lock "cinder-quobyte-1f69c0d3-8afa-4671-9117-0b9b5e7cff3c" acquired by "delete_volume" :: waited 0.019s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29f7b6a-ce80-4968-b536-5409c6a09fff]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:56:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f6d262b7-34af-4e22-9f46-594003bdb688 tempest-AttachVolumeNegativeTest-866639513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1f69c0d3-8afa-4671-9117-0b9b5e7cff3c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:40 devstack sudo[97827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1f69c0d3-8afa-4671-9117-0b9b5e7cff3c
Sep 04 15:56:40 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:41 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-01dc1daa-608a-4bcb-a671-6935dc9372d1 1073741824" returned: 0 in 0.625s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-01dc1daa-608a-4bcb-a671-6935dc9372d1 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:41 devstack sudo[97835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-01dc1daa-608a-4bcb-a671-6935dc9372d1
Sep 04 15:56:41 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:41 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f6d262b7-34af-4e22-9f46-594003bdb688 tempest-AttachVolumeNegativeTest-866639513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1f69c0d3-8afa-4671-9117-0b9b5e7cff3c" returned: 0 in 0.500s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f6d262b7-34af-4e22-9f46-594003bdb688 tempest-AttachVolumeNegativeTest-866639513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1f69c0d3-8afa-4671-9117-0b9b5e7cff3c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:41 devstack sudo[97839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1f69c0d3-8afa-4671-9117-0b9b5e7cff3c
Sep 04 15:56:41 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:41 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-01dc1daa-608a-4bcb-a671-6935dc9372d1" returned: 0 in 0.395s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:41 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:56:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36dd8a03-8fb3-462d-850d-0110afc4a0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01dc1daa-608a-4bcb-a671-6935dc9372d1', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f1a7ca8-0bb8-4049-8bbe-98544db4b4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:41 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Volume volume-01dc1daa-608a-4bcb-a671-6935dc9372d1 (01dc1daa-608a-4bcb-a671-6935dc9372d1): created successfully
Sep 04 15:56:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f1a7ca8-0bb8-4049-8bbe-98544db4b4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Flow 'volume_create_manager' (d1bc7260-7642-4eb1-8cf0-2ed143c2e84d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:56:41 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-c5480652-92e5-4b63-aa0e-ed8d8be97ced tempest-VolumesActionsTest-1359162431 None] Created volume successfully.
Sep 04 15:56:41 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f6d262b7-34af-4e22-9f46-594003bdb688 tempest-AttachVolumeNegativeTest-866639513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1f69c0d3-8afa-4671-9117-0b9b5e7cff3c" returned: 0 in 0.486s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:41 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f6d262b7-34af-4e22-9f46-594003bdb688 tempest-AttachVolumeNegativeTest-866639513 None] Lock "cinder-quobyte-1f69c0d3-8afa-4671-9117-0b9b5e7cff3c" released by "delete_volume" :: held 1.039s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:41 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-f6d262b7-34af-4e22-9f46-594003bdb688 tempest-AttachVolumeNegativeTest-866639513 None] Created reservations ['10eb9c0f-404e-4737-9286-7e7e03cc1d5e', 'a515e71b-a14d-4eb2-8dd6-263f8977326f', '3ac1d97f-eab3-45ae-bd74-ee11be967e46', '74330d23-4fe1-421c-a736-8abae104a3c5'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:56:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f6d262b7-34af-4e22-9f46-594003bdb688 tempest-AttachVolumeNegativeTest-866639513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f6d262b7-34af-4e22-9f46-594003bdb688 tempest-AttachVolumeNegativeTest-866639513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:41 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f6d262b7-34af-4e22-9f46-594003bdb688 tempest-AttachVolumeNegativeTest-866639513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:41 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f6d262b7-34af-4e22-9f46-594003bdb688 tempest-AttachVolumeNegativeTest-866639513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f6d262b7-34af-4e22-9f46-594003bdb688 tempest-AttachVolumeNegativeTest-866639513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f6d262b7-34af-4e22-9f46-594003bdb688 tempest-AttachVolumeNegativeTest-866639513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:41 devstack sudo[97843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:56:41 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:42 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f6d262b7-34af-4e22-9f46-594003bdb688 tempest-AttachVolumeNegativeTest-866639513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.328s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:42 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-f6d262b7-34af-4e22-9f46-594003bdb688 tempest-AttachVolumeNegativeTest-866639513 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:56:42 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f6d262b7-34af-4e22-9f46-594003bdb688 tempest-AttachVolumeNegativeTest-866639513 None] Deleted volume successfully.
Sep 04 15:56:42 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f6d262b7-34af-4e22-9f46-594003bdb688 tempest-AttachVolumeNegativeTest-866639513 None] Lock "cinder-1f69c0d3-8afa-4671-9117-0b9b5e7cff3c-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:42 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ee203ef0-a8a8-4ba4-a1f8-af3d76590167 tempest-VolumesActionsTest-1341054969 None] Acquiring lock "cinder-01dc1daa-608a-4bcb-a671-6935dc9372d1-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:42 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ee203ef0-a8a8-4ba4-a1f8-af3d76590167 tempest-VolumesActionsTest-1341054969 None] Lock "cinder-01dc1daa-608a-4bcb-a671-6935dc9372d1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:42 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ee203ef0-a8a8-4ba4-a1f8-af3d76590167 tempest-VolumesActionsTest-1341054969 None] Acquiring lock "cinder-quobyte-01dc1daa-608a-4bcb-a671-6935dc9372d1" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:42 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ee203ef0-a8a8-4ba4-a1f8-af3d76590167 tempest-VolumesActionsTest-1341054969 None] Lock "cinder-quobyte-01dc1daa-608a-4bcb-a671-6935dc9372d1" acquired by "delete_volume" :: waited 0.019s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:42 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[73383554-c3fe-46cb-9097-a71f48fa3f61]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:56:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ee203ef0-a8a8-4ba4-a1f8-af3d76590167 tempest-VolumesActionsTest-1341054969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-01dc1daa-608a-4bcb-a671-6935dc9372d1 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-58194d13-6d40-404c-adea-2fdc88d0b500 tempest-AttachVolumeNegativeTest-866639513 None] Acquiring lock "cinder-74038134-d3eb-476e-94c2-823fc8f81a63-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:43 devstack sudo[97846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-01dc1daa-608a-4bcb-a671-6935dc9372d1
Sep 04 15:56:43 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-58194d13-6d40-404c-adea-2fdc88d0b500 tempest-AttachVolumeNegativeTest-866639513 None] Lock "cinder-74038134-d3eb-476e-94c2-823fc8f81a63-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-58194d13-6d40-404c-adea-2fdc88d0b500 tempest-AttachVolumeNegativeTest-866639513 None] Acquiring lock "cinder-quobyte-74038134-d3eb-476e-94c2-823fc8f81a63" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-58194d13-6d40-404c-adea-2fdc88d0b500 tempest-AttachVolumeNegativeTest-866639513 None] Lock "cinder-quobyte-74038134-d3eb-476e-94c2-823fc8f81a63" acquired by "delete_volume" :: waited 0.021s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:43 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[add9a7cf-c02f-47e6-bd59-11e8c76437d5]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:56:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-58194d13-6d40-404c-adea-2fdc88d0b500 tempest-AttachVolumeNegativeTest-866639513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-74038134-d3eb-476e-94c2-823fc8f81a63 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:43 devstack sudo[97848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-74038134-d3eb-476e-94c2-823fc8f81a63
Sep 04 15:56:43 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:43 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ee203ef0-a8a8-4ba4-a1f8-af3d76590167 tempest-VolumesActionsTest-1341054969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-01dc1daa-608a-4bcb-a671-6935dc9372d1" returned: 0 in 0.499s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ee203ef0-a8a8-4ba4-a1f8-af3d76590167 tempest-VolumesActionsTest-1341054969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-01dc1daa-608a-4bcb-a671-6935dc9372d1 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:43 devstack sudo[97853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-01dc1daa-608a-4bcb-a671-6935dc9372d1
Sep 04 15:56:43 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:43 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-58194d13-6d40-404c-adea-2fdc88d0b500 tempest-AttachVolumeNegativeTest-866639513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-74038134-d3eb-476e-94c2-823fc8f81a63" returned: 0 in 0.477s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-58194d13-6d40-404c-adea-2fdc88d0b500 tempest-AttachVolumeNegativeTest-866639513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-74038134-d3eb-476e-94c2-823fc8f81a63 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:43 devstack sudo[97860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-74038134-d3eb-476e-94c2-823fc8f81a63
Sep 04 15:56:43 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:43 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ee203ef0-a8a8-4ba4-a1f8-af3d76590167 tempest-VolumesActionsTest-1341054969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-01dc1daa-608a-4bcb-a671-6935dc9372d1" returned: 0 in 0.283s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ee203ef0-a8a8-4ba4-a1f8-af3d76590167 tempest-VolumesActionsTest-1341054969 None] Lock "cinder-quobyte-01dc1daa-608a-4bcb-a671-6935dc9372d1" released by "delete_volume" :: held 0.851s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:43 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-ee203ef0-a8a8-4ba4-a1f8-af3d76590167 tempest-VolumesActionsTest-1341054969 None] Created reservations ['4561a417-1f6b-4ad7-af7c-ee2fca31b595', 'f7ed9432-e128-4bb6-9fa8-0e62f53b2897', 'afa64bd2-71e8-48f9-bc0c-6b9f94e4f1dc', '8c67769e-29a8-4759-91b8-23d5321e234b'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:56:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ee203ef0-a8a8-4ba4-a1f8-af3d76590167 tempest-VolumesActionsTest-1341054969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ee203ef0-a8a8-4ba4-a1f8-af3d76590167 tempest-VolumesActionsTest-1341054969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ee203ef0-a8a8-4ba4-a1f8-af3d76590167 tempest-VolumesActionsTest-1341054969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ee203ef0-a8a8-4ba4-a1f8-af3d76590167 tempest-VolumesActionsTest-1341054969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ee203ef0-a8a8-4ba4-a1f8-af3d76590167 tempest-VolumesActionsTest-1341054969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ee203ef0-a8a8-4ba4-a1f8-af3d76590167 tempest-VolumesActionsTest-1341054969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:44 devstack sudo[97864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:56:44 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:44 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-58194d13-6d40-404c-adea-2fdc88d0b500 tempest-AttachVolumeNegativeTest-866639513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-74038134-d3eb-476e-94c2-823fc8f81a63" returned: 0 in 0.346s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-58194d13-6d40-404c-adea-2fdc88d0b500 tempest-AttachVolumeNegativeTest-866639513 None] Lock "cinder-quobyte-74038134-d3eb-476e-94c2-823fc8f81a63" released by "delete_volume" :: held 0.892s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:44 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-58194d13-6d40-404c-adea-2fdc88d0b500 tempest-AttachVolumeNegativeTest-866639513 None] Created reservations ['82a4ade8-da05-439f-9211-6d7f17429c18', 'f17b2317-1297-433f-b499-2171741be923', '7883700e-7e4e-4872-b246-b96eb08cb7bb', 'd72f995b-9763-4856-bfe3-581e159e138e'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:56:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-58194d13-6d40-404c-adea-2fdc88d0b500 tempest-AttachVolumeNegativeTest-866639513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-58194d13-6d40-404c-adea-2fdc88d0b500 tempest-AttachVolumeNegativeTest-866639513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-58194d13-6d40-404c-adea-2fdc88d0b500 tempest-AttachVolumeNegativeTest-866639513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:44 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-58194d13-6d40-404c-adea-2fdc88d0b500 tempest-AttachVolumeNegativeTest-866639513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-58194d13-6d40-404c-adea-2fdc88d0b500 tempest-AttachVolumeNegativeTest-866639513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-58194d13-6d40-404c-adea-2fdc88d0b500 tempest-AttachVolumeNegativeTest-866639513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ee203ef0-a8a8-4ba4-a1f8-af3d76590167 tempest-VolumesActionsTest-1341054969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.392s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:44 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ee203ef0-a8a8-4ba4-a1f8-af3d76590167 tempest-VolumesActionsTest-1341054969 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:56:44 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-ee203ef0-a8a8-4ba4-a1f8-af3d76590167 tempest-VolumesActionsTest-1341054969 None] Deleted volume successfully.
Sep 04 15:56:44 devstack sudo[97886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:56:44 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ee203ef0-a8a8-4ba4-a1f8-af3d76590167 tempest-VolumesActionsTest-1341054969 None] Lock "cinder-01dc1daa-608a-4bcb-a671-6935dc9372d1-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:44 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-58194d13-6d40-404c-adea-2fdc88d0b500 tempest-AttachVolumeNegativeTest-866639513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.444s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:44 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-58194d13-6d40-404c-adea-2fdc88d0b500 tempest-AttachVolumeNegativeTest-866639513 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:56:44 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-58194d13-6d40-404c-adea-2fdc88d0b500 tempest-AttachVolumeNegativeTest-866639513 None] Deleted volume successfully.
Sep 04 15:56:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-58194d13-6d40-404c-adea-2fdc88d0b500 tempest-AttachVolumeNegativeTest-866639513 None] Lock "cinder-74038134-d3eb-476e-94c2-823fc8f81a63-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:44 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:56:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Flow 'volume_create_manager' (a5917494-fe0f-433c-ba32-68f12ccf847f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:56:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685dc332-2e47-4907-8fd4-9451ac97521e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685dc332-2e47-4907-8fd4-9451ac97521e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2021679619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=901c1a87-c5dd-4a26-ae29-7a82f2417b0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba5813a1cf64c26a581b08b81d9551c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:45Z,use_quota=True,user_id='fadb030cb2174ca98b0e2d21c2a92728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b20b9d8-a88a-4b37-ace5-d765baa5c2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b20b9d8-a88a-4b37-ace5-d765baa5c2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6631e56a-03a3-4c53-85cd-c825924b48fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6631e56a-03a3-4c53-85cd-c825924b48fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '901c1a87-c5dd-4a26-ae29-7a82f2417b0e', 'volume_name': 'volume-901c1a87-c5dd-4a26-ae29-7a82f2417b0e', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58387f55-149c-4ec6-84d2-502b4bf40fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58387f55-149c-4ec6-84d2-502b4bf40fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae57cec-5af2-46b3-9a71-03e0358cec64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:45 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Volume 901c1a87-c5dd-4a26-ae29-7a82f2417b0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-901c1a87-c5dd-4a26-ae29-7a82f2417b0e', 'volume_size': 1}
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2021679619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=901c1a87-c5dd-4a26-ae29-7a82f2417b0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba5813a1cf64c26a581b08b81d9551c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:45Z,use_quota=True,user_id='fadb030cb2174ca98b0e2d21c2a92728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Creating volume 901c1a87-c5dd-4a26-ae29-7a82f2417b0e {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:56:45 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-901c1a87-c5dd-4a26-ae29-7a82f2417b0e 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:45 devstack sudo[97890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-901c1a87-c5dd-4a26-ae29-7a82f2417b0e 1073741824
Sep 04 15:56:45 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:45 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-901c1a87-c5dd-4a26-ae29-7a82f2417b0e 1073741824" returned: 0 in 0.536s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-901c1a87-c5dd-4a26-ae29-7a82f2417b0e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:45 devstack sudo[97897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-901c1a87-c5dd-4a26-ae29-7a82f2417b0e
Sep 04 15:56:45 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bb1500de-223b-43d1-8218-4c7a4b9e1da8 tempest-AttachVolumeNegativeTest-866639513 None] Acquiring lock "cinder-18ba3c32-15ab-448f-a0cc-de265fbc8890-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bb1500de-223b-43d1-8218-4c7a4b9e1da8 tempest-AttachVolumeNegativeTest-866639513 None] Lock "cinder-18ba3c32-15ab-448f-a0cc-de265fbc8890-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bb1500de-223b-43d1-8218-4c7a4b9e1da8 tempest-AttachVolumeNegativeTest-866639513 None] Acquiring lock "cinder-quobyte-18ba3c32-15ab-448f-a0cc-de265fbc8890" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bb1500de-223b-43d1-8218-4c7a4b9e1da8 tempest-AttachVolumeNegativeTest-866639513 None] Lock "cinder-quobyte-18ba3c32-15ab-448f-a0cc-de265fbc8890" acquired by "delete_volume" :: waited 0.040s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[599c79ee-4647-4524-8c2a-b96d263d6505]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bb1500de-223b-43d1-8218-4c7a4b9e1da8 tempest-AttachVolumeNegativeTest-866639513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-18ba3c32-15ab-448f-a0cc-de265fbc8890 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:45 devstack sudo[97899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-18ba3c32-15ab-448f-a0cc-de265fbc8890
Sep 04 15:56:45 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:45 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-901c1a87-c5dd-4a26-ae29-7a82f2417b0e" returned: 0 in 0.328s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae57cec-5af2-46b3-9a71-03e0358cec64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-901c1a87-c5dd-4a26-ae29-7a82f2417b0e', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b13649-c634-4c9f-98c3-46ec4f7c06b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:45 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Volume volume-901c1a87-c5dd-4a26-ae29-7a82f2417b0e (901c1a87-c5dd-4a26-ae29-7a82f2417b0e): created successfully
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b13649-c634-4c9f-98c3-46ec4f7c06b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:45 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Flow 'volume_create_manager' (a5917494-fe0f-433c-ba32-68f12ccf847f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:56:45 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-09c7dcad-f205-48a3-a7f4-fdf6121b1070 tempest-VolumesActionsTest-1359162431 None] Created volume successfully.
Sep 04 15:56:46 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bb1500de-223b-43d1-8218-4c7a4b9e1da8 tempest-AttachVolumeNegativeTest-866639513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-18ba3c32-15ab-448f-a0cc-de265fbc8890" returned: 0 in 0.391s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bb1500de-223b-43d1-8218-4c7a4b9e1da8 tempest-AttachVolumeNegativeTest-866639513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-18ba3c32-15ab-448f-a0cc-de265fbc8890 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:46 devstack sudo[97905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-18ba3c32-15ab-448f-a0cc-de265fbc8890
Sep 04 15:56:46 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:46 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bb1500de-223b-43d1-8218-4c7a4b9e1da8 tempest-AttachVolumeNegativeTest-866639513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-18ba3c32-15ab-448f-a0cc-de265fbc8890" returned: 0 in 0.260s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:46 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bb1500de-223b-43d1-8218-4c7a4b9e1da8 tempest-AttachVolumeNegativeTest-866639513 None] Lock "cinder-quobyte-18ba3c32-15ab-448f-a0cc-de265fbc8890" released by "delete_volume" :: held 0.698s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:46 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=96,cinder:INSERT=25,cinder:UPDATE=108,cinder:DELETE=10 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:56:46 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:UPDATE=124,cinder:SELECT=80,cinder:INSERT=27,cinder:DELETE=10 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:56:46 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-bb1500de-223b-43d1-8218-4c7a4b9e1da8 tempest-AttachVolumeNegativeTest-866639513 None] Created reservations ['69483396-6a15-436f-9ed7-cbafcffb7bc9', '871ecc95-0d5d-4b75-bca2-9e28d07d9335', 'f900dded-d766-442e-bb26-045ea6359cd0', '699c6639-998a-47b0-b1cf-5037a6162458'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:56:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bb1500de-223b-43d1-8218-4c7a4b9e1da8 tempest-AttachVolumeNegativeTest-866639513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bb1500de-223b-43d1-8218-4c7a4b9e1da8 tempest-AttachVolumeNegativeTest-866639513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:46 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bb1500de-223b-43d1-8218-4c7a4b9e1da8 tempest-AttachVolumeNegativeTest-866639513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:46 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bb1500de-223b-43d1-8218-4c7a4b9e1da8 tempest-AttachVolumeNegativeTest-866639513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bb1500de-223b-43d1-8218-4c7a4b9e1da8 tempest-AttachVolumeNegativeTest-866639513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bb1500de-223b-43d1-8218-4c7a4b9e1da8 tempest-AttachVolumeNegativeTest-866639513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:46 devstack sudo[97908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:56:46 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:46 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bb1500de-223b-43d1-8218-4c7a4b9e1da8 tempest-AttachVolumeNegativeTest-866639513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.251s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:46 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-bb1500de-223b-43d1-8218-4c7a4b9e1da8 tempest-AttachVolumeNegativeTest-866639513 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:56:46 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-bb1500de-223b-43d1-8218-4c7a4b9e1da8 tempest-AttachVolumeNegativeTest-866639513 None] Deleted volume successfully.
Sep 04 15:56:46 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bb1500de-223b-43d1-8218-4c7a4b9e1da8 tempest-AttachVolumeNegativeTest-866639513 None] Lock "cinder-18ba3c32-15ab-448f-a0cc-de265fbc8890-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b40fd031-85c4-41ae-b8ff-8af5dfbdbcce tempest-VolumesActionsTest-1359162431 None] Acquiring lock "cinder-901c1a87-c5dd-4a26-ae29-7a82f2417b0e-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b40fd031-85c4-41ae-b8ff-8af5dfbdbcce tempest-VolumesActionsTest-1359162431 None] Lock "cinder-901c1a87-c5dd-4a26-ae29-7a82f2417b0e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b40fd031-85c4-41ae-b8ff-8af5dfbdbcce tempest-VolumesActionsTest-1359162431 None] Acquiring lock "cinder-quobyte-901c1a87-c5dd-4a26-ae29-7a82f2417b0e" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b40fd031-85c4-41ae-b8ff-8af5dfbdbcce tempest-VolumesActionsTest-1359162431 None] Lock "cinder-quobyte-901c1a87-c5dd-4a26-ae29-7a82f2417b0e" acquired by "delete_volume" :: waited 0.021s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:47 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63da834-233d-42d6-8036-7c37a115f997]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:56:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b40fd031-85c4-41ae-b8ff-8af5dfbdbcce tempest-VolumesActionsTest-1359162431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-901c1a87-c5dd-4a26-ae29-7a82f2417b0e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:47 devstack sudo[97911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-901c1a87-c5dd-4a26-ae29-7a82f2417b0e
Sep 04 15:56:47 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:48 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b40fd031-85c4-41ae-b8ff-8af5dfbdbcce tempest-VolumesActionsTest-1359162431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-901c1a87-c5dd-4a26-ae29-7a82f2417b0e" returned: 0 in 0.390s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b40fd031-85c4-41ae-b8ff-8af5dfbdbcce tempest-VolumesActionsTest-1359162431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-901c1a87-c5dd-4a26-ae29-7a82f2417b0e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:48 devstack sudo[97917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-901c1a87-c5dd-4a26-ae29-7a82f2417b0e
Sep 04 15:56:48 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:48 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b40fd031-85c4-41ae-b8ff-8af5dfbdbcce tempest-VolumesActionsTest-1359162431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-901c1a87-c5dd-4a26-ae29-7a82f2417b0e" returned: 0 in 0.284s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:48 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b40fd031-85c4-41ae-b8ff-8af5dfbdbcce tempest-VolumesActionsTest-1359162431 None] Lock "cinder-quobyte-901c1a87-c5dd-4a26-ae29-7a82f2417b0e" released by "delete_volume" :: held 0.731s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:48 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-b40fd031-85c4-41ae-b8ff-8af5dfbdbcce tempest-VolumesActionsTest-1359162431 None] Created reservations ['f4a2a33a-7765-492a-9e7b-6ebf290c0a87', '1c26c3a8-2a9c-493c-bf31-65245f754918', '96fc21eb-ad54-4d9e-a430-682ed2e73305', '6718ea9c-4504-4545-82d0-dc21a9bbc2f8'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:56:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b40fd031-85c4-41ae-b8ff-8af5dfbdbcce tempest-VolumesActionsTest-1359162431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b40fd031-85c4-41ae-b8ff-8af5dfbdbcce tempest-VolumesActionsTest-1359162431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b40fd031-85c4-41ae-b8ff-8af5dfbdbcce tempest-VolumesActionsTest-1359162431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b40fd031-85c4-41ae-b8ff-8af5dfbdbcce tempest-VolumesActionsTest-1359162431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b40fd031-85c4-41ae-b8ff-8af5dfbdbcce tempest-VolumesActionsTest-1359162431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b40fd031-85c4-41ae-b8ff-8af5dfbdbcce tempest-VolumesActionsTest-1359162431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:48 devstack sudo[97921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:56:48 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:48 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:56:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:48 devstack sudo[97923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:56:48 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:48 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b40fd031-85c4-41ae-b8ff-8af5dfbdbcce tempest-VolumesActionsTest-1359162431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.370s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-b40fd031-85c4-41ae-b8ff-8af5dfbdbcce tempest-VolumesActionsTest-1359162431 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:56:49 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-b40fd031-85c4-41ae-b8ff-8af5dfbdbcce tempest-VolumesActionsTest-1359162431 None] Deleted volume successfully.
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Flow 'volume_create_manager' (2cee475b-85d9-4b3b-927a-0a70dc4135bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71837970-ff57-447c-a862-4fd0a04598cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b40fd031-85c4-41ae-b8ff-8af5dfbdbcce tempest-VolumesActionsTest-1359162431 None] Lock "cinder-901c1a87-c5dd-4a26-ae29-7a82f2417b0e-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71837970-ff57-447c-a862-4fd0a04598cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1205862104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8921d342-d3f7-43ad-89a3-62b31b0d2dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95084752753143f690ebf9c2d729e9ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:49Z,use_quota=True,user_id='e662b85e2aa545988a2eba693adfb853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8793236d-8b17-42c6-a42b-2b6ba06ba23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8793236d-8b17-42c6-a42b-2b6ba06ba23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9346da2a-8a60-4d1e-be21-845308823cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9346da2a-8a60-4d1e-be21-845308823cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8921d342-d3f7-43ad-89a3-62b31b0d2dcb', 'volume_name': 'volume-8921d342-d3f7-43ad-89a3-62b31b0d2dcb', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe991f8e-b4cd-4d09-a246-f1c56274f6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe991f8e-b4cd-4d09-a246-f1c56274f6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3105e4b4-fc05-40a2-9664-0ef3dd61711c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:49 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Volume 8921d342-d3f7-43ad-89a3-62b31b0d2dcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8921d342-d3f7-43ad-89a3-62b31b0d2dcb', 'volume_size': 1}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1205862104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8921d342-d3f7-43ad-89a3-62b31b0d2dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95084752753143f690ebf9c2d729e9ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:49Z,use_quota=True,user_id='e662b85e2aa545988a2eba693adfb853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Creating volume 8921d342-d3f7-43ad-89a3-62b31b0d2dcb {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:56:49 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8921d342-d3f7-43ad-89a3-62b31b0d2dcb 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:49 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.334s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager._thread_info {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread count: 28 {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread info: [<_MainThread(MainThread, started 131673838448768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131673724603200)>, <Thread(Thread-3 (stat_writer), started daemon 131673723495936)>, <Thread(Rabbit-heartbeat, started daemon 131673723764800)>, <Thread(Thread-5 (_runner), started daemon 131673722269632)>, <Thread(Thread-7 (_runner), started daemon 131673722322112)>, <Thread(fd_logger, started daemon 131673722585024)>, <Thread(privsep_reader, started daemon 131673721593984)>, <Thread(tpool_thread_0, started daemon 131673714706112)>, <Thread(tpool_thread_1, started daemon 131673706313408)>, <Thread(tpool_thread_2, started daemon 131673697920704)>, <Thread(tpool_thread_3, started daemon 131673689528000)>, <Thread(tpool_thread_4, started daemon 131673681135296)>, <Thread(tpool_thread_5, started daemon 131673672726208)>, <Thread(tpool_thread_6, started daemon 131673664317120)>, <Thread(tpool_thread_7, started daemon 131673655908032)>, <Thread(tpool_thread_8, started daemon 131673647498944)>, <Thread(tpool_thread_9, started daemon 131673639089856)>, <Thread(tpool_thread_10, started daemon 131673630680768)>, <Thread(tpool_thread_11, started daemon 131673622271680)>, <Thread(tpool_thread_12, started daemon 131673613862592)>, <Thread(tpool_thread_13, started daemon 131673605453504)>, <Thread(tpool_thread_14, started daemon 131673597044416)>, <Thread(tpool_thread_15, started daemon 131673588635328)>, <Thread(tpool_thread_16, started daemon 131673580226240)>, <Thread(tpool_thread_17, started daemon 131673571817152)>, <Thread(tpool_thread_18, started daemon 131673563408064)>, <Thread(tpool_thread_19, started daemon 131673554998976)>] {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 15:56:49 devstack sudo[97927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8921d342-d3f7-43ad-89a3-62b31b0d2dcb 1073741824
Sep 04 15:56:49 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:49 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8921d342-d3f7-43ad-89a3-62b31b0d2dcb 1073741824" returned: 0 in 0.507s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8921d342-d3f7-43ad-89a3-62b31b0d2dcb {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:49 devstack sudo[97933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8921d342-d3f7-43ad-89a3-62b31b0d2dcb
Sep 04 15:56:49 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:49 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8921d342-d3f7-43ad-89a3-62b31b0d2dcb" returned: 0 in 0.301s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:56:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3105e4b4-fc05-40a2-9664-0ef3dd61711c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8921d342-d3f7-43ad-89a3-62b31b0d2dcb', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e69cdb-965e-45c5-b29f-4f98b2330fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:50 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Volume volume-8921d342-d3f7-43ad-89a3-62b31b0d2dcb (8921d342-d3f7-43ad-89a3-62b31b0d2dcb): created successfully
Sep 04 15:56:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e69cdb-965e-45c5-b29f-4f98b2330fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Flow 'volume_create_manager' (2cee475b-85d9-4b3b-927a-0a70dc4135bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:56:50 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-6596f18b-147f-4ec8-ab4c-c507c5caa3e2 tempest-VolumesTransfersV357Test-2122665952 None] Created volume successfully.
Sep 04 15:56:51 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-4a793b19-1efe-4b86-8ded-a8720911634c tempest-VolumesTransfersV357Test-1839347559 None] Transfer volume completed successfully.
Sep 04 15:56:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b881c78b-d376-42a8-a637-07bd9e207022 tempest-VolumesTransfersV357Test-2007566822 None] Acquiring lock "cinder-8921d342-d3f7-43ad-89a3-62b31b0d2dcb-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b881c78b-d376-42a8-a637-07bd9e207022 tempest-VolumesTransfersV357Test-2007566822 None] Lock "cinder-8921d342-d3f7-43ad-89a3-62b31b0d2dcb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b881c78b-d376-42a8-a637-07bd9e207022 tempest-VolumesTransfersV357Test-2007566822 None] Acquiring lock "cinder-quobyte-8921d342-d3f7-43ad-89a3-62b31b0d2dcb" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b881c78b-d376-42a8-a637-07bd9e207022 tempest-VolumesTransfersV357Test-2007566822 None] Lock "cinder-quobyte-8921d342-d3f7-43ad-89a3-62b31b0d2dcb" acquired by "delete_volume" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:52 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce313fb3-8b7b-4b64-b996-08791ffbbd86]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:56:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b881c78b-d376-42a8-a637-07bd9e207022 tempest-VolumesTransfersV357Test-2007566822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8921d342-d3f7-43ad-89a3-62b31b0d2dcb {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:53 devstack sudo[97939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8921d342-d3f7-43ad-89a3-62b31b0d2dcb
Sep 04 15:56:53 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:53 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b881c78b-d376-42a8-a637-07bd9e207022 tempest-VolumesTransfersV357Test-2007566822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8921d342-d3f7-43ad-89a3-62b31b0d2dcb" returned: 0 in 0.401s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b881c78b-d376-42a8-a637-07bd9e207022 tempest-VolumesTransfersV357Test-2007566822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8921d342-d3f7-43ad-89a3-62b31b0d2dcb {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:53 devstack sudo[97944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8921d342-d3f7-43ad-89a3-62b31b0d2dcb
Sep 04 15:56:53 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:53 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b881c78b-d376-42a8-a637-07bd9e207022 tempest-VolumesTransfersV357Test-2007566822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8921d342-d3f7-43ad-89a3-62b31b0d2dcb" returned: 0 in 0.423s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b881c78b-d376-42a8-a637-07bd9e207022 tempest-VolumesTransfersV357Test-2007566822 None] Lock "cinder-quobyte-8921d342-d3f7-43ad-89a3-62b31b0d2dcb" released by "delete_volume" :: held 0.867s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:53 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-b881c78b-d376-42a8-a637-07bd9e207022 tempest-VolumesTransfersV357Test-2007566822 None] Created reservations ['c902f3cb-1bd2-48fd-85be-fe9cfe06dbdd', '17392f17-7bfc-481c-8343-f444e8c3e12f', '9864d01c-583a-43d7-8cbf-34ba056c90fd', 'c1cdb846-9310-4812-8196-32186fb91d61'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:56:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b881c78b-d376-42a8-a637-07bd9e207022 tempest-VolumesTransfersV357Test-2007566822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b881c78b-d376-42a8-a637-07bd9e207022 tempest-VolumesTransfersV357Test-2007566822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b881c78b-d376-42a8-a637-07bd9e207022 tempest-VolumesTransfersV357Test-2007566822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b881c78b-d376-42a8-a637-07bd9e207022 tempest-VolumesTransfersV357Test-2007566822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b881c78b-d376-42a8-a637-07bd9e207022 tempest-VolumesTransfersV357Test-2007566822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b881c78b-d376-42a8-a637-07bd9e207022 tempest-VolumesTransfersV357Test-2007566822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:53 devstack sudo[97947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:56:53 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:54 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b881c78b-d376-42a8-a637-07bd9e207022 tempest-VolumesTransfersV357Test-2007566822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.533s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:54 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-b881c78b-d376-42a8-a637-07bd9e207022 tempest-VolumesTransfersV357Test-2007566822 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:56:54 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-b881c78b-d376-42a8-a637-07bd9e207022 tempest-VolumesTransfersV357Test-2007566822 None] Deleted volume successfully.
Sep 04 15:56:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b881c78b-d376-42a8-a637-07bd9e207022 tempest-VolumesTransfersV357Test-2007566822 None] Lock "cinder-8921d342-d3f7-43ad-89a3-62b31b0d2dcb-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:54 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:56:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Flow 'volume_create_manager' (2a752820-2697-452c-ad05-64f32f967368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:56:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213d0e16-f0e9-4c08-ac68-3c237c510913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213d0e16-f0e9-4c08-ac68-3c237c510913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1672913999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ed2520-8394-49f7-babf-922bd24a64e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95084752753143f690ebf9c2d729e9ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:55Z,use_quota=True,user_id='e662b85e2aa545988a2eba693adfb853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1156489-2853-4157-861f-403a50ae0642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1156489-2853-4157-861f-403a50ae0642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7149e471-f0d7-40d2-831f-2105d15645b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7149e471-f0d7-40d2-831f-2105d15645b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3ed2520-8394-49f7-babf-922bd24a64e7', 'volume_name': 'volume-c3ed2520-8394-49f7-babf-922bd24a64e7', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5af632-e682-4c93-af3b-ec3528888556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5af632-e682-4c93-af3b-ec3528888556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb34c483-4a0d-4d21-b274-bc8f871c0e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:54 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Volume c3ed2520-8394-49f7-babf-922bd24a64e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3ed2520-8394-49f7-babf-922bd24a64e7', 'volume_size': 1}
Sep 04 15:56:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1672913999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ed2520-8394-49f7-babf-922bd24a64e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95084752753143f690ebf9c2d729e9ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:55Z,use_quota=True,user_id='e662b85e2aa545988a2eba693adfb853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:56:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Creating volume c3ed2520-8394-49f7-babf-922bd24a64e7 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:56:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:56:54 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:56:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c3ed2520-8394-49f7-babf-922bd24a64e7 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:55 devstack sudo[97952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c3ed2520-8394-49f7-babf-922bd24a64e7 1073741824
Sep 04 15:56:55 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:55 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c3ed2520-8394-49f7-babf-922bd24a64e7 1073741824" returned: 0 in 0.565s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c3ed2520-8394-49f7-babf-922bd24a64e7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:55 devstack sudo[97960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c3ed2520-8394-49f7-babf-922bd24a64e7
Sep 04 15:56:55 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:55 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c3ed2520-8394-49f7-babf-922bd24a64e7" returned: 0 in 0.310s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:56:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb34c483-4a0d-4d21-b274-bc8f871c0e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3ed2520-8394-49f7-babf-922bd24a64e7', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b64bbc2-5891-492a-bac0-df522b563259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:56 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Volume volume-c3ed2520-8394-49f7-babf-922bd24a64e7 (c3ed2520-8394-49f7-babf-922bd24a64e7): created successfully
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b64bbc2-5891-492a-bac0-df522b563259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Flow 'volume_create_manager' (2a752820-2697-452c-ad05-64f32f967368) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:56:56 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-65046c6b-bc59-42aa-aade-5ccc562e4771 tempest-VolumesTransfersV357Test-2122665952 None] Created volume successfully.
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Flow 'volume_create_manager' (d096a9c3-e912-4e8b-b356-f3ff3b757c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37507a98-909c-4a87-8b1a-9943ff45799b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37507a98-909c-4a87-8b1a-9943ff45799b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-729745927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=002503db-ac6e-4ded-b0b3-0dfc0150cc40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e25c7c5faf84a5683492c9d67c93f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:56Z,use_quota=True,user_id='b379860e0b1c4ce58d44a249eea49db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb600b6c-c859-4ac5-9100-a59294034f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb600b6c-c859-4ac5-9100-a59294034f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480f2bb2-97ea-4667-be4a-68c14c55b9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480f2bb2-97ea-4667-be4a-68c14c55b9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '002503db-ac6e-4ded-b0b3-0dfc0150cc40', 'volume_name': 'volume-002503db-ac6e-4ded-b0b3-0dfc0150cc40', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4486c67e-114b-4a30-86a4-b07bd37b6dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4486c67e-114b-4a30-86a4-b07bd37b6dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9476d6f2-f316-4b42-96d3-5b6d8de6e4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:56 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Volume 002503db-ac6e-4ded-b0b3-0dfc0150cc40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-002503db-ac6e-4ded-b0b3-0dfc0150cc40', 'volume_size': 1}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-729745927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=002503db-ac6e-4ded-b0b3-0dfc0150cc40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e25c7c5faf84a5683492c9d67c93f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:56Z,use_quota=True,user_id='b379860e0b1c4ce58d44a249eea49db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Creating volume 002503db-ac6e-4ded-b0b3-0dfc0150cc40 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:56:56 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-002503db-ac6e-4ded-b0b3-0dfc0150cc40 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:56 devstack sudo[97963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-002503db-ac6e-4ded-b0b3-0dfc0150cc40 1073741824
Sep 04 15:56:56 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Flow 'volume_create_manager' (e9e6b22e-8ac1-4892-bfa6-7d3dec8bae04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb957d38-d721-495c-a33a-b7a6f4911dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb957d38-d721-495c-a33a-b7a6f4911dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2004601257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=442017cd-1746-4aec-8a55-8728efae0092,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c874661b4f304fb1a5247d78fd30c9e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:56Z,use_quota=True,user_id='310aebfb2586454fbc99c9033b69e820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d226e7fe-d775-46a1-b5f6-da068a82936d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d226e7fe-d775-46a1-b5f6-da068a82936d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (538e22bb-7634-4b4d-94a9-528a098b778a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (538e22bb-7634-4b4d-94a9-528a098b778a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '442017cd-1746-4aec-8a55-8728efae0092', 'volume_name': 'volume-442017cd-1746-4aec-8a55-8728efae0092', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb8f5548-e4e1-40cd-9608-e2cd46bd320a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb8f5548-e4e1-40cd-9608-e2cd46bd320a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f598c9-1d4c-45e8-8844-1d91ba847824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:56 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Volume 442017cd-1746-4aec-8a55-8728efae0092: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-442017cd-1746-4aec-8a55-8728efae0092', 'volume_size': 1}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:56 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-002503db-ac6e-4ded-b0b3-0dfc0150cc40 1073741824" returned: 0 in 0.464s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-002503db-ac6e-4ded-b0b3-0dfc0150cc40 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:56 devstack sudo[97969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-002503db-ac6e-4ded-b0b3-0dfc0150cc40
Sep 04 15:56:56 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:57 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-002503db-ac6e-4ded-b0b3-0dfc0150cc40" returned: 0 in 0.286s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:57 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:56:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.597s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:57 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2004601257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=442017cd-1746-4aec-8a55-8728efae0092,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c874661b4f304fb1a5247d78fd30c9e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:56Z,use_quota=True,user_id='310aebfb2586454fbc99c9033b69e820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:56:57 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Creating volume 442017cd-1746-4aec-8a55-8728efae0092 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:56:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:57 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:57 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:57 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:56:57 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:56:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-442017cd-1746-4aec-8a55-8728efae0092 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9476d6f2-f316-4b42-96d3-5b6d8de6e4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-002503db-ac6e-4ded-b0b3-0dfc0150cc40', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653de434-a195-4130-91d6-b63c9d0955c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:57 devstack sudo[97972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-442017cd-1746-4aec-8a55-8728efae0092 1073741824
Sep 04 15:56:57 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:57 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Volume volume-002503db-ac6e-4ded-b0b3-0dfc0150cc40 (002503db-ac6e-4ded-b0b3-0dfc0150cc40): created successfully
Sep 04 15:56:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653de434-a195-4130-91d6-b63c9d0955c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Flow 'volume_create_manager' (d096a9c3-e912-4e8b-b356-f3ff3b757c74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:56:57 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-715bfcf2-61de-4b29-8023-6454598ea378 tempest-AttachVolumeTestJSON-1246579971 None] Created volume successfully.
Sep 04 15:56:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bbb46687-9fe8-4c2c-a7a1-a20e15046951 tempest-VolumesTransfersV357Test-2007566822 None] Acquiring lock "cinder-c3ed2520-8394-49f7-babf-922bd24a64e7-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bbb46687-9fe8-4c2c-a7a1-a20e15046951 tempest-VolumesTransfersV357Test-2007566822 None] Lock "cinder-c3ed2520-8394-49f7-babf-922bd24a64e7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bbb46687-9fe8-4c2c-a7a1-a20e15046951 tempest-VolumesTransfersV357Test-2007566822 None] Acquiring lock "cinder-quobyte-c3ed2520-8394-49f7-babf-922bd24a64e7" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:56:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bbb46687-9fe8-4c2c-a7a1-a20e15046951 tempest-VolumesTransfersV357Test-2007566822 None] Lock "cinder-quobyte-c3ed2520-8394-49f7-babf-922bd24a64e7" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:56:57 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-442017cd-1746-4aec-8a55-8728efae0092 1073741824" returned: 0 in 0.618s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:57 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce435d9b-3849-40b9-a319-8956bd954bfd]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:56:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bbb46687-9fe8-4c2c-a7a1-a20e15046951 tempest-VolumesTransfersV357Test-2007566822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c3ed2520-8394-49f7-babf-922bd24a64e7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-442017cd-1746-4aec-8a55-8728efae0092 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:57 devstack sudo[97979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-442017cd-1746-4aec-8a55-8728efae0092
Sep 04 15:56:57 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:57 devstack sudo[97978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c3ed2520-8394-49f7-babf-922bd24a64e7
Sep 04 15:56:57 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:58 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-442017cd-1746-4aec-8a55-8728efae0092" returned: 0 in 0.322s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:58 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:56:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f598c9-1d4c-45e8-8844-1d91ba847824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-442017cd-1746-4aec-8a55-8728efae0092', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc3f6761-0fcf-4260-b870-82d04bc2cc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:58 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Volume volume-442017cd-1746-4aec-8a55-8728efae0092 (442017cd-1746-4aec-8a55-8728efae0092): created successfully
Sep 04 15:56:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc3f6761-0fcf-4260-b870-82d04bc2cc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Flow 'volume_create_manager' (e9e6b22e-8ac1-4892-bfa6-7d3dec8bae04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:56:58 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f24270f2-aa7f-4a54-8f55-c07de587ba40 tempest-VolumesTestJSON-1325757757 None] Created volume successfully.
Sep 04 15:56:58 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bbb46687-9fe8-4c2c-a7a1-a20e15046951 tempest-VolumesTransfersV357Test-2007566822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c3ed2520-8394-49f7-babf-922bd24a64e7" returned: 0 in 0.468s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bbb46687-9fe8-4c2c-a7a1-a20e15046951 tempest-VolumesTransfersV357Test-2007566822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c3ed2520-8394-49f7-babf-922bd24a64e7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:58 devstack sudo[97987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c3ed2520-8394-49f7-babf-922bd24a64e7
Sep 04 15:56:58 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:58 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bbb46687-9fe8-4c2c-a7a1-a20e15046951 tempest-VolumesTransfersV357Test-2007566822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c3ed2520-8394-49f7-babf-922bd24a64e7" returned: 0 in 0.377s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:58 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bbb46687-9fe8-4c2c-a7a1-a20e15046951 tempest-VolumesTransfersV357Test-2007566822 None] Lock "cinder-quobyte-c3ed2520-8394-49f7-babf-922bd24a64e7" released by "delete_volume" :: held 0.919s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:58 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-bbb46687-9fe8-4c2c-a7a1-a20e15046951 tempest-VolumesTransfersV357Test-2007566822 None] Created reservations ['c15ced76-8ebb-438f-8863-8ba400e08684', 'c73d5e29-abb5-4402-9d44-e1d754aa3ede', '407427d9-e900-407d-8063-86be84b86af1', '3169d263-4941-4e63-bfdd-a4d1437c67f9'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:56:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bbb46687-9fe8-4c2c-a7a1-a20e15046951 tempest-VolumesTransfersV357Test-2007566822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bbb46687-9fe8-4c2c-a7a1-a20e15046951 tempest-VolumesTransfersV357Test-2007566822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:58 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bbb46687-9fe8-4c2c-a7a1-a20e15046951 tempest-VolumesTransfersV357Test-2007566822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:58 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bbb46687-9fe8-4c2c-a7a1-a20e15046951 tempest-VolumesTransfersV357Test-2007566822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bbb46687-9fe8-4c2c-a7a1-a20e15046951 tempest-VolumesTransfersV357Test-2007566822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bbb46687-9fe8-4c2c-a7a1-a20e15046951 tempest-VolumesTransfersV357Test-2007566822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:58 devstack sudo[97993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:56:58 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:59 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bbb46687-9fe8-4c2c-a7a1-a20e15046951 tempest-VolumesTransfersV357Test-2007566822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.385s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-bbb46687-9fe8-4c2c-a7a1-a20e15046951 tempest-VolumesTransfersV357Test-2007566822 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:56:59 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-bbb46687-9fe8-4c2c-a7a1-a20e15046951 tempest-VolumesTransfersV357Test-2007566822 None] Deleted volume successfully.
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bbb46687-9fe8-4c2c-a7a1-a20e15046951 tempest-VolumesTransfersV357Test-2007566822 None] Lock "cinder-c3ed2520-8394-49f7-babf-922bd24a64e7-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-3181c9b8-e617-4896-980e-341128df1771 req-74c69af3-528d-4aec-8671-2398f03cb0ab tempest-AttachVolumeTestJSON-1246579971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-3181c9b8-e617-4896-980e-341128df1771 req-74c69af3-528d-4aec-8671-2398f03cb0ab tempest-AttachVolumeTestJSON-1246579971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-3181c9b8-e617-4896-980e-341128df1771 req-74c69af3-528d-4aec-8671-2398f03cb0ab tempest-AttachVolumeTestJSON-1246579971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.094s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Flow 'volume_create_manager' (38633c41-f14b-47f4-8c9a-d7fa50d80618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (134b7590-66fa-4e3f-a9be-8aadb17c1dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (134b7590-66fa-4e3f-a9be-8aadb17c1dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1980539199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4adf9700-b790-4269-a134-eac604b139fa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c874661b4f304fb1a5247d78fd30c9e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:59Z,use_quota=True,user_id='310aebfb2586454fbc99c9033b69e820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd78a03-013a-4656-a5ae-8ee7857e3bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd78a03-013a-4656-a5ae-8ee7857e3bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c82edc5-d4e7-4e5d-b268-5af39cfe3dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c82edc5-d4e7-4e5d-b268-5af39cfe3dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4adf9700-b790-4269-a134-eac604b139fa', 'volume_name': 'volume-4adf9700-b790-4269-a134-eac604b139fa', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe517e1-ce78-42cf-869b-c56992b6c7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe517e1-ce78-42cf-869b-c56992b6c7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b540077-d1a1-4a2b-a1a4-96aabe3806c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:56:59 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Volume 4adf9700-b790-4269-a134-eac604b139fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4adf9700-b790-4269-a134-eac604b139fa', 'volume_size': 1}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1980539199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4adf9700-b790-4269-a134-eac604b139fa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c874661b4f304fb1a5247d78fd30c9e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:59Z,use_quota=True,user_id='310aebfb2586454fbc99c9033b69e820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Creating volume 4adf9700-b790-4269-a134-eac604b139fa {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:56:59 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4adf9700-b790-4269-a134-eac604b139fa 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:56:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-3181c9b8-e617-4896-980e-341128df1771 req-74c69af3-528d-4aec-8671-2398f03cb0ab tempest-AttachVolumeTestJSON-1246579971 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236', 'name': 'volume-002503db-ac6e-4ded-b0b3-0dfc0150cc40', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cee82394-3244-4782-8f17-3e19930819ed', 'enforce_multipath': True} {{(pid=87504) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 15:56:59 devstack sudo[98004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4adf9700-b790-4269-a134-eac604b139fa 1073741824
Sep 04 15:56:59 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:56:59 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-3181c9b8-e617-4896-980e-341128df1771 req-74c69af3-528d-4aec-8671-2398f03cb0ab tempest-AttachVolumeTestJSON-1246579971 None] attachment_update completed successfully.
Sep 04 15:57:00 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4adf9700-b790-4269-a134-eac604b139fa 1073741824" returned: 0 in 0.743s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4adf9700-b790-4269-a134-eac604b139fa {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:00 devstack sudo[98425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4adf9700-b790-4269-a134-eac604b139fa
Sep 04 15:57:00 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:00 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4adf9700-b790-4269-a134-eac604b139fa" returned: 0 in 0.304s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:57:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b540077-d1a1-4a2b-a1a4-96aabe3806c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4adf9700-b790-4269-a134-eac604b139fa', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f67d1fb-25eb-452b-846d-e1570a376c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:00 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Volume volume-4adf9700-b790-4269-a134-eac604b139fa (4adf9700-b790-4269-a134-eac604b139fa): created successfully
Sep 04 15:57:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f67d1fb-25eb-452b-846d-e1570a376c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Flow 'volume_create_manager' (38633c41-f14b-47f4-8c9a-d7fa50d80618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:00 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-2d96acbc-96d9-4c08-b95b-871e878c063c tempest-VolumesTestJSON-1325757757 None] Created volume successfully.
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Flow 'volume_create_manager' (741bee1b-f8ca-462e-b851-cd97ddffc2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1491bf4e-6c4b-4281-86a8-d86a71756f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1491bf4e-6c4b-4281-86a8-d86a71756f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-182917560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee882ec-ba9c-49c2-b0c7-597b03377b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e25c7c5faf84a5683492c9d67c93f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:02Z,use_quota=True,user_id='b379860e0b1c4ce58d44a249eea49db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34a5591-fcb7-49ad-b06c-5b797cebba3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34a5591-fcb7-49ad-b06c-5b797cebba3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc5a578a-a6a8-4005-b2b6-65e922699eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc5a578a-a6a8-4005-b2b6-65e922699eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ee882ec-ba9c-49c2-b0c7-597b03377b35', 'volume_name': 'volume-7ee882ec-ba9c-49c2-b0c7-597b03377b35', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c097d1-dc36-4f29-8f9d-f85d769aec3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c097d1-dc36-4f29-8f9d-f85d769aec3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (890f2638-276d-4895-96d6-dcdb85aa8443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:02 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Volume 7ee882ec-ba9c-49c2-b0c7-597b03377b35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ee882ec-ba9c-49c2-b0c7-597b03377b35', 'volume_size': 1}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-182917560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee882ec-ba9c-49c2-b0c7-597b03377b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e25c7c5faf84a5683492c9d67c93f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:02Z,use_quota=True,user_id='b379860e0b1c4ce58d44a249eea49db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Creating volume 7ee882ec-ba9c-49c2-b0c7-597b03377b35 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:57:02 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7ee882ec-ba9c-49c2-b0c7-597b03377b35 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:57:02 devstack sudo[98432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7ee882ec-ba9c-49c2-b0c7-597b03377b35 1073741824
Sep 04 15:57:02 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Flow 'volume_create_manager' (de255788-9827-4c15-8f13-a3f6a8264ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f71ed8-9a34-4f9a-beb6-b986bad26fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f71ed8-9a34-4f9a-beb6-b986bad26fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1767865621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c874661b4f304fb1a5247d78fd30c9e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:02Z,use_quota=True,user_id='310aebfb2586454fbc99c9033b69e820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf652f7c-5169-45c7-9c7a-63289f7fc988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf652f7c-5169-45c7-9c7a-63289f7fc988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (664039b6-8475-4a12-be4a-b1aac79ae0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (664039b6-8475-4a12-be4a-b1aac79ae0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3', 'volume_name': 'volume-20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065377fe-1148-447d-917e-63157b79e4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065377fe-1148-447d-917e-63157b79e4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a62698-7520-4cf4-a6a1-d66c42fc10f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:02 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Volume 20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3', 'volume_size': 1}
Sep 04 15:57:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:03 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7ee882ec-ba9c-49c2-b0c7-597b03377b35 1073741824" returned: 0 in 0.560s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7ee882ec-ba9c-49c2-b0c7-597b03377b35 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:03 devstack sudo[98440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7ee882ec-ba9c-49c2-b0c7-597b03377b35
Sep 04 15:57:03 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:03 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7ee882ec-ba9c-49c2-b0c7-597b03377b35" returned: 0 in 0.293s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:03 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:57:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.788s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:03 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1767865621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c874661b4f304fb1a5247d78fd30c9e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:02Z,use_quota=True,user_id='310aebfb2586454fbc99c9033b69e820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:57:03 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Creating volume 20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:57:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:03 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:03 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:03 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:57:03 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:57:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:03 devstack sudo[98443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3 1073741824
Sep 04 15:57:03 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (890f2638-276d-4895-96d6-dcdb85aa8443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ee882ec-ba9c-49c2-b0c7-597b03377b35', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002e85b8-002a-4abc-8676-7b5cd0ceefd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:03 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Volume volume-7ee882ec-ba9c-49c2-b0c7-597b03377b35 (7ee882ec-ba9c-49c2-b0c7-597b03377b35): created successfully
Sep 04 15:57:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002e85b8-002a-4abc-8676-7b5cd0ceefd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Flow 'volume_create_manager' (741bee1b-f8ca-462e-b851-cd97ddffc2a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:03 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-fd2e4de6-13c4-4e08-b9e3-782a5718292f tempest-AttachVolumeTestJSON-1246579971 None] Created volume successfully.
Sep 04 15:57:04 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3 1073741824" returned: 0 in 0.540s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:04 devstack sudo[98449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3
Sep 04 15:57:04 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:04 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3" returned: 0 in 0.364s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:04 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:57:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a62698-7520-4cf4-a6a1-d66c42fc10f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780159c7-d107-4d17-b541-390f839310fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:04 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Volume volume-20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3 (20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3): created successfully
Sep 04 15:57:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780159c7-d107-4d17-b541-390f839310fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Flow 'volume_create_manager' (de255788-9827-4c15-8f13-a3f6a8264ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:04 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-6a816f53-36c2-4fea-8741-410a8cd0aee1 tempest-VolumesTestJSON-1325757757 None] Created volume successfully.
Sep 04 15:57:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-b068b329-642e-4f79-b28b-189add56f39c req-36dcc060-ce17-476c-8758-75bef539f5eb tempest-AttachVolumeTestJSON-1246579971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-b068b329-642e-4f79-b28b-189add56f39c req-36dcc060-ce17-476c-8758-75bef539f5eb tempest-AttachVolumeTestJSON-1246579971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-b068b329-642e-4f79-b28b-189add56f39c req-36dcc060-ce17-476c-8758-75bef539f5eb tempest-AttachVolumeTestJSON-1246579971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-b068b329-642e-4f79-b28b-189add56f39c req-36dcc060-ce17-476c-8758-75bef539f5eb tempest-AttachVolumeTestJSON-1246579971 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236', 'name': 'volume-7ee882ec-ba9c-49c2-b0c7-597b03377b35', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f351207-e1a4-42b6-9022-1c972cedc148', 'enforce_multipath': True} {{(pid=87504) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 15:57:05 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-b068b329-642e-4f79-b28b-189add56f39c req-36dcc060-ce17-476c-8758-75bef539f5eb tempest-AttachVolumeTestJSON-1246579971 None] attachment_update completed successfully.
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-83d4b295-ef3d-4e99-ad58-77bdaa625d7d tempest-VolumesTestJSON-1325757757 None] Acquiring lock "cinder-20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-83d4b295-ef3d-4e99-ad58-77bdaa625d7d tempest-VolumesTestJSON-1325757757 None] Lock "cinder-20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-83d4b295-ef3d-4e99-ad58-77bdaa625d7d tempest-VolumesTestJSON-1325757757 None] Acquiring lock "cinder-quobyte-20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-83d4b295-ef3d-4e99-ad58-77bdaa625d7d tempest-VolumesTestJSON-1325757757 None] Lock "cinder-quobyte-20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3" acquired by "delete_volume" :: waited 0.050s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[76af8bdf-6080-4e12-98bf-8d917152905b]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-83d4b295-ef3d-4e99-ad58-77bdaa625d7d tempest-VolumesTestJSON-1325757757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:07 devstack sudo[98470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3
Sep 04 15:57:07 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:07 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-cd8c94f4-09e7-456b-a8a2-96c9e8c50e1d req-11116931-ebd0-420c-8cb5-0de895550c33 tempest-AttachVolumeTestJSON-1246579971 None] Terminate volume connection completed successfully.
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-cd8c94f4-09e7-456b-a8a2-96c9e8c50e1d req-11116931-ebd0-420c-8cb5-0de895550c33 tempest-AttachVolumeTestJSON-1246579971 None] Deleting attachment cee82394-3244-4782-8f17-3e19930819ed. {{(pid=87504) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Flow 'volume_create_manager' (7298d74c-9293-476e-80bc-5174aceaa623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d673ec2-b387-46bd-9f4f-0dc3865768f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d673ec2-b387-46bd-9f4f-0dc3865768f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-635449192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=572a007f-b9dc-44fa-8507-09c6739282b0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4b6c277473a44f819a2785f8e459d058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:08Z,use_quota=True,user_id='71aaedd9a29b44df9edb60fbb98be877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed9bd19-ec06-462f-9b6c-3360eab1e176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed9bd19-ec06-462f-9b6c-3360eab1e176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24f4ebdc-ad4f-4d6b-9364-911ab40302fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24f4ebdc-ad4f-4d6b-9364-911ab40302fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '572a007f-b9dc-44fa-8507-09c6739282b0', 'volume_name': 'volume-572a007f-b9dc-44fa-8507-09c6739282b0', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e518577a-a1e9-43f9-95c4-dc1c21361da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e518577a-a1e9-43f9-95c4-dc1c21361da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e3df57d-8c3c-4568-899d-7f621e4680ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:07 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Volume 572a007f-b9dc-44fa-8507-09c6739282b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-572a007f-b9dc-44fa-8507-09c6739282b0', 'volume_size': 1}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-635449192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=572a007f-b9dc-44fa-8507-09c6739282b0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4b6c277473a44f819a2785f8e459d058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:08Z,use_quota=True,user_id='71aaedd9a29b44df9edb60fbb98be877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Creating volume 572a007f-b9dc-44fa-8507-09c6739282b0 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:57:07 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-572a007f-b9dc-44fa-8507-09c6739282b0 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:07 devstack sudo[98473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-572a007f-b9dc-44fa-8507-09c6739282b0 1073741824
Sep 04 15:57:07 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:07 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-83d4b295-ef3d-4e99-ad58-77bdaa625d7d tempest-VolumesTestJSON-1325757757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3" returned: 0 in 0.479s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-83d4b295-ef3d-4e99-ad58-77bdaa625d7d tempest-VolumesTestJSON-1325757757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:07 devstack sudo[98477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3
Sep 04 15:57:07 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:08 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-83d4b295-ef3d-4e99-ad58-77bdaa625d7d tempest-VolumesTestJSON-1325757757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3" returned: 0 in 0.297s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:08 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-83d4b295-ef3d-4e99-ad58-77bdaa625d7d tempest-VolumesTestJSON-1325757757 None] Lock "cinder-quobyte-20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3" released by "delete_volume" :: held 0.863s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:08 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-83d4b295-ef3d-4e99-ad58-77bdaa625d7d tempest-VolumesTestJSON-1325757757 None] Created reservations ['73edbe9e-1a07-4452-9ed6-2a556bc76dec', '2bda9aba-cb09-4e7c-ad54-f3781283d782', '72370e2a-a026-477b-8724-eb3e6e4469ba', '5b265f6d-aa69-40b2-8585-741c499852bd'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:57:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-83d4b295-ef3d-4e99-ad58-77bdaa625d7d tempest-VolumesTestJSON-1325757757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-83d4b295-ef3d-4e99-ad58-77bdaa625d7d tempest-VolumesTestJSON-1325757757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-83d4b295-ef3d-4e99-ad58-77bdaa625d7d tempest-VolumesTestJSON-1325757757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-83d4b295-ef3d-4e99-ad58-77bdaa625d7d tempest-VolumesTestJSON-1325757757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-83d4b295-ef3d-4e99-ad58-77bdaa625d7d tempest-VolumesTestJSON-1325757757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-83d4b295-ef3d-4e99-ad58-77bdaa625d7d tempest-VolumesTestJSON-1325757757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:08 devstack sudo[98484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:57:08 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:08 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2d22401e-8500-4020-902d-a76717a372da tempest-VolumesTestJSON-1325757757 None] Acquiring lock "cinder-4adf9700-b790-4269-a134-eac604b139fa-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:08 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:08 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2d22401e-8500-4020-902d-a76717a372da tempest-VolumesTestJSON-1325757757 None] Lock "cinder-4adf9700-b790-4269-a134-eac604b139fa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-572a007f-b9dc-44fa-8507-09c6739282b0 1073741824" returned: 0 in 0.740s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-572a007f-b9dc-44fa-8507-09c6739282b0 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:08 devstack sudo[98486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-572a007f-b9dc-44fa-8507-09c6739282b0
Sep 04 15:57:08 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:08 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2d22401e-8500-4020-902d-a76717a372da tempest-VolumesTestJSON-1325757757 None] Acquiring lock "cinder-quobyte-4adf9700-b790-4269-a134-eac604b139fa" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:08 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2d22401e-8500-4020-902d-a76717a372da tempest-VolumesTestJSON-1325757757 None] Lock "cinder-quobyte-4adf9700-b790-4269-a134-eac604b139fa" acquired by "delete_volume" :: waited 0.031s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:08 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a781e424-5335-4181-b093-28e299aa7cb6]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d22401e-8500-4020-902d-a76717a372da tempest-VolumesTestJSON-1325757757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4adf9700-b790-4269-a134-eac604b139fa {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:08 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-83d4b295-ef3d-4e99-ad58-77bdaa625d7d tempest-VolumesTestJSON-1325757757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.400s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:08 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-83d4b295-ef3d-4e99-ad58-77bdaa625d7d tempest-VolumesTestJSON-1325757757 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:57:08 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-83d4b295-ef3d-4e99-ad58-77bdaa625d7d tempest-VolumesTestJSON-1325757757 None] Deleted volume successfully.
Sep 04 15:57:08 devstack sudo[98488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4adf9700-b790-4269-a134-eac604b139fa
Sep 04 15:57:08 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:08 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-83d4b295-ef3d-4e99-ad58-77bdaa625d7d tempest-VolumesTestJSON-1325757757 None] Lock "cinder-20cc3fcb-5000-4ade-a0a7-f6abeecf9ad3-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:09 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-572a007f-b9dc-44fa-8507-09c6739282b0" returned: 0 in 0.448s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:09 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:57:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e3df57d-8c3c-4568-899d-7f621e4680ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-572a007f-b9dc-44fa-8507-09c6739282b0', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ccf8199-3526-46c3-a3e3-001db00a92af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:09 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-9b31e6a6-d57d-484c-9fb6-7822adabe98e req-90a1e46b-097f-4126-b746-96d724c4b787 tempest-AttachVolumeTestJSON-1246579971 None] Terminate volume connection completed successfully.
Sep 04 15:57:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-9b31e6a6-d57d-484c-9fb6-7822adabe98e req-90a1e46b-097f-4126-b746-96d724c4b787 tempest-AttachVolumeTestJSON-1246579971 None] Deleting attachment 5f351207-e1a4-42b6-9022-1c972cedc148. {{(pid=87504) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 15:57:09 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Volume volume-572a007f-b9dc-44fa-8507-09c6739282b0 (572a007f-b9dc-44fa-8507-09c6739282b0): created successfully
Sep 04 15:57:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ccf8199-3526-46c3-a3e3-001db00a92af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Flow 'volume_create_manager' (7298d74c-9293-476e-80bc-5174aceaa623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:09 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-65fbb244-dc15-4eb5-8a37-3ebb12dcf58b tempest-VolumesGetTest-886688485 None] Created volume successfully.
Sep 04 15:57:09 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d22401e-8500-4020-902d-a76717a372da tempest-VolumesTestJSON-1325757757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4adf9700-b790-4269-a134-eac604b139fa" returned: 0 in 0.485s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d22401e-8500-4020-902d-a76717a372da tempest-VolumesTestJSON-1325757757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4adf9700-b790-4269-a134-eac604b139fa {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:09 devstack sudo[98522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4adf9700-b790-4269-a134-eac604b139fa
Sep 04 15:57:09 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:09 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d22401e-8500-4020-902d-a76717a372da tempest-VolumesTestJSON-1325757757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4adf9700-b790-4269-a134-eac604b139fa" returned: 0 in 0.304s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:09 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2d22401e-8500-4020-902d-a76717a372da tempest-VolumesTestJSON-1325757757 None] Lock "cinder-quobyte-4adf9700-b790-4269-a134-eac604b139fa" released by "delete_volume" :: held 0.855s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:09 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-2d22401e-8500-4020-902d-a76717a372da tempest-VolumesTestJSON-1325757757 None] Created reservations ['b0d09577-de6e-429c-a1c4-441005f8251f', '80613d5e-6aae-45ee-8639-c93e652e9447', '349579d2-f30d-4c77-9805-d034c4ef62ec', 'd4151e40-d8a4-4d89-a4e3-7901954c6692'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:57:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2d22401e-8500-4020-902d-a76717a372da tempest-VolumesTestJSON-1325757757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2d22401e-8500-4020-902d-a76717a372da tempest-VolumesTestJSON-1325757757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:09 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2d22401e-8500-4020-902d-a76717a372da tempest-VolumesTestJSON-1325757757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:09 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2d22401e-8500-4020-902d-a76717a372da tempest-VolumesTestJSON-1325757757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2d22401e-8500-4020-902d-a76717a372da tempest-VolumesTestJSON-1325757757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d22401e-8500-4020-902d-a76717a372da tempest-VolumesTestJSON-1325757757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:09 devstack sudo[98525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:57:09 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:09 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-adf40729-a346-4e36-8840-acba68d17cee tempest-VolumesTestJSON-1325757757 None] Acquiring lock "cinder-442017cd-1746-4aec-8a55-8728efae0092-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:09 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-adf40729-a346-4e36-8840-acba68d17cee tempest-VolumesTestJSON-1325757757 None] Lock "cinder-442017cd-1746-4aec-8a55-8728efae0092-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:09 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-adf40729-a346-4e36-8840-acba68d17cee tempest-VolumesTestJSON-1325757757 None] Acquiring lock "cinder-quobyte-442017cd-1746-4aec-8a55-8728efae0092" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:09 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-adf40729-a346-4e36-8840-acba68d17cee tempest-VolumesTestJSON-1325757757 None] Lock "cinder-quobyte-442017cd-1746-4aec-8a55-8728efae0092" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:09 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[10024f6b-591f-4a4a-84c4-a1b0daa95968]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-adf40729-a346-4e36-8840-acba68d17cee tempest-VolumesTestJSON-1325757757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-442017cd-1746-4aec-8a55-8728efae0092 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:10 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d22401e-8500-4020-902d-a76717a372da tempest-VolumesTestJSON-1325757757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.426s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:10 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-2d22401e-8500-4020-902d-a76717a372da tempest-VolumesTestJSON-1325757757 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:57:10 devstack sudo[98527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-442017cd-1746-4aec-8a55-8728efae0092
Sep 04 15:57:10 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-2d22401e-8500-4020-902d-a76717a372da tempest-VolumesTestJSON-1325757757 None] Deleted volume successfully.
Sep 04 15:57:10 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:10 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2d22401e-8500-4020-902d-a76717a372da tempest-VolumesTestJSON-1325757757 None] Lock "cinder-4adf9700-b790-4269-a134-eac604b139fa-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:10 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-adf40729-a346-4e36-8840-acba68d17cee tempest-VolumesTestJSON-1325757757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-442017cd-1746-4aec-8a55-8728efae0092" returned: 0 in 0.577s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-adf40729-a346-4e36-8840-acba68d17cee tempest-VolumesTestJSON-1325757757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-442017cd-1746-4aec-8a55-8728efae0092 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:10 devstack sudo[98533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-442017cd-1746-4aec-8a55-8728efae0092
Sep 04 15:57:10 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:11 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-adf40729-a346-4e36-8840-acba68d17cee tempest-VolumesTestJSON-1325757757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-442017cd-1746-4aec-8a55-8728efae0092" returned: 0 in 0.528s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-adf40729-a346-4e36-8840-acba68d17cee tempest-VolumesTestJSON-1325757757 None] Lock "cinder-quobyte-442017cd-1746-4aec-8a55-8728efae0092" released by "delete_volume" :: held 1.180s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Flow 'volume_create_manager' (613daf43-16f5-4f5f-a55a-af9ce63e1aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0452a1-66f4-4515-aa27-a1b84452ea2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0452a1-66f4-4515-aa27-a1b84452ea2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-974857524',display_name='tempest-VolumesGetTest-Volume-1679710123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6c277473a44f819a2785f8e459d058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:11Z,use_quota=True,user_id='71aaedd9a29b44df9edb60fbb98be877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cba4149-9437-4f4d-b4c8-70bfc4bea7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cba4149-9437-4f4d-b4c8-70bfc4bea7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f0d53e-d75e-404f-a6bb-b427093c18c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f0d53e-d75e-404f-a6bb-b427093c18c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e', 'volume_name': 'volume-27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2480b20e-5b47-44a3-a081-ab86d06aa044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2480b20e-5b47-44a3-a081-ab86d06aa044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7d9e16-7735-4258-a2ec-722c5409cc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:11 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Volume 27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e', 'volume_size': 1}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-974857524',display_name='tempest-VolumesGetTest-Volume-1679710123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6c277473a44f819a2785f8e459d058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:11Z,use_quota=True,user_id='71aaedd9a29b44df9edb60fbb98be877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Creating volume 27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:57:11 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:11 devstack sudo[98556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e 1073741824
Sep 04 15:57:11 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-adf40729-a346-4e36-8840-acba68d17cee tempest-VolumesTestJSON-1325757757 None] Created reservations ['7d0c8698-ba7a-4a7e-8a05-90c321026f17', '27aa2842-0082-44de-a639-a2b60a739356', '8817c2c7-fe12-48b1-be85-b9dba6c0717d', 'ba7f17f4-a46a-49bd-951e-411ae2c36989'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-adf40729-a346-4e36-8840-acba68d17cee tempest-VolumesTestJSON-1325757757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-adf40729-a346-4e36-8840-acba68d17cee tempest-VolumesTestJSON-1325757757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-adf40729-a346-4e36-8840-acba68d17cee tempest-VolumesTestJSON-1325757757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-adf40729-a346-4e36-8840-acba68d17cee tempest-VolumesTestJSON-1325757757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-adf40729-a346-4e36-8840-acba68d17cee tempest-VolumesTestJSON-1325757757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-adf40729-a346-4e36-8840-acba68d17cee tempest-VolumesTestJSON-1325757757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:11 devstack sudo[98558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:57:11 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:11 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-adf40729-a346-4e36-8840-acba68d17cee tempest-VolumesTestJSON-1325757757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.299s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-adf40729-a346-4e36-8840-acba68d17cee tempest-VolumesTestJSON-1325757757 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:57:11 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-adf40729-a346-4e36-8840-acba68d17cee tempest-VolumesTestJSON-1325757757 None] Deleted volume successfully.
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-adf40729-a346-4e36-8840-acba68d17cee tempest-VolumesTestJSON-1325757757 None] Lock "cinder-442017cd-1746-4aec-8a55-8728efae0092-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:11 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e 1073741824" returned: 0 in 0.599s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:11 devstack sudo[98565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e
Sep 04 15:57:11 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:12 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e" returned: 0 in 0.444s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Flow 'volume_create_manager' (3e6b68da-281b-4f64-9583-4e56f7e70677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de4c4a0d-6a86-443e-b26c-63a07c40cb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de4c4a0d-6a86-443e-b26c-63a07c40cb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-622876583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e2ffe1d-41b5-4631-b552-dac3cbc48a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7d00f7b00f40baaacb359d4cefa28d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:12Z,use_quota=True,user_id='90d53049303e48ab804accf5026205fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082984c5-cf08-4825-9d32-b38f15ab07ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082984c5-cf08-4825-9d32-b38f15ab07ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af293a4a-fa67-4a02-9e8a-acb40e6eee40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af293a4a-fa67-4a02-9e8a-acb40e6eee40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e2ffe1d-41b5-4631-b552-dac3cbc48a6a', 'volume_name': 'volume-4e2ffe1d-41b5-4631-b552-dac3cbc48a6a', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e40db1-80a8-4912-9ffe-fed2eea23582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e40db1-80a8-4912-9ffe-fed2eea23582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0867dda1-e692-440b-ac65-4da6d2736277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:12 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Volume 4e2ffe1d-41b5-4631-b552-dac3cbc48a6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e2ffe1d-41b5-4631-b552-dac3cbc48a6a', 'volume_size': 1}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-622876583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e2ffe1d-41b5-4631-b552-dac3cbc48a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7d00f7b00f40baaacb359d4cefa28d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:12Z,use_quota=True,user_id='90d53049303e48ab804accf5026205fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Creating volume 4e2ffe1d-41b5-4631-b552-dac3cbc48a6a {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:57:12 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4e2ffe1d-41b5-4631-b552-dac3cbc48a6a 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7d9e16-7735-4258-a2ec-722c5409cc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e79d5e-7318-40dd-8441-076914c0bf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:12 devstack sudo[98570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4e2ffe1d-41b5-4631-b552-dac3cbc48a6a 1073741824
Sep 04 15:57:12 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:12 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Volume volume-27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e (27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e): created successfully
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e79d5e-7318-40dd-8441-076914c0bf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Flow 'volume_create_manager' (613daf43-16f5-4f5f-a55a-af9ce63e1aa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:12 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-eab3380b-c6c0-46a8-8470-eec9d3f1453c tempest-VolumesGetTest-886688485 None] Created volume successfully.
Sep 04 15:57:13 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4e2ffe1d-41b5-4631-b552-dac3cbc48a6a 1073741824" returned: 0 in 0.600s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4e2ffe1d-41b5-4631-b552-dac3cbc48a6a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-be42a224-18f0-46d7-9cd1-f5062f0d728f tempest-VolumesGetTest-886688485 None] Acquiring lock "cinder-27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:13 devstack sudo[98576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4e2ffe1d-41b5-4631-b552-dac3cbc48a6a
Sep 04 15:57:13 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-be42a224-18f0-46d7-9cd1-f5062f0d728f tempest-VolumesGetTest-886688485 None] Lock "cinder-27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-be42a224-18f0-46d7-9cd1-f5062f0d728f tempest-VolumesGetTest-886688485 None] Acquiring lock "cinder-quobyte-27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-be42a224-18f0-46d7-9cd1-f5062f0d728f tempest-VolumesGetTest-886688485 None] Lock "cinder-quobyte-27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e" acquired by "delete_volume" :: waited 0.016s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:13 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6062363d-9f5f-4703-a3f9-ba4c3c6a7777]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-be42a224-18f0-46d7-9cd1-f5062f0d728f tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:13 devstack sudo[98578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e
Sep 04 15:57:13 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:13 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4e2ffe1d-41b5-4631-b552-dac3cbc48a6a" returned: 0 in 0.427s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:57:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0867dda1-e692-440b-ac65-4da6d2736277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e2ffe1d-41b5-4631-b552-dac3cbc48a6a', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05637335-df7a-4a15-87ab-feda59c9694c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:13 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Volume volume-4e2ffe1d-41b5-4631-b552-dac3cbc48a6a (4e2ffe1d-41b5-4631-b552-dac3cbc48a6a): created successfully
Sep 04 15:57:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05637335-df7a-4a15-87ab-feda59c9694c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Flow 'volume_create_manager' (3e6b68da-281b-4f64-9583-4e56f7e70677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:13 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-6aa9f3c7-8f7a-423f-ad5f-b740051c58e4 tempest-VolumesTransfersV355Test-680018593 None] Created volume successfully.
Sep 04 15:57:13 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-be42a224-18f0-46d7-9cd1-f5062f0d728f tempest-VolumesGetTest-886688485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e" returned: 0 in 0.556s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-be42a224-18f0-46d7-9cd1-f5062f0d728f tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:13 devstack sudo[98584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e
Sep 04 15:57:13 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:14 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-be42a224-18f0-46d7-9cd1-f5062f0d728f tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e" returned: 0 in 0.238s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-be42a224-18f0-46d7-9cd1-f5062f0d728f tempest-VolumesGetTest-886688485 None] Lock "cinder-quobyte-27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e" released by "delete_volume" :: held 0.852s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:14 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-be42a224-18f0-46d7-9cd1-f5062f0d728f tempest-VolumesGetTest-886688485 None] Created reservations ['774fff84-dfdd-4788-87a9-95ae73d7583e', '2d0cda9f-95d5-4175-b9fb-20ad62ef50f6', '9a53be1c-2f96-41fa-9cb3-94079209f32b', 'ae0ce3ef-3682-4be5-a029-4e29da31d6e9'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:57:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-be42a224-18f0-46d7-9cd1-f5062f0d728f tempest-VolumesGetTest-886688485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-be42a224-18f0-46d7-9cd1-f5062f0d728f tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:14 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-be42a224-18f0-46d7-9cd1-f5062f0d728f tempest-VolumesGetTest-886688485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:14 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-be42a224-18f0-46d7-9cd1-f5062f0d728f tempest-VolumesGetTest-886688485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-be42a224-18f0-46d7-9cd1-f5062f0d728f tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-be42a224-18f0-46d7-9cd1-f5062f0d728f tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:14 devstack sudo[98588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:57:14 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-11a0af0d-049c-4dc3-a9c0-3492c333e626 tempest-VolumesGetTest-886688485 None] Acquiring lock "cinder-572a007f-b9dc-44fa-8507-09c6739282b0-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-11a0af0d-049c-4dc3-a9c0-3492c333e626 tempest-VolumesGetTest-886688485 None] Lock "cinder-572a007f-b9dc-44fa-8507-09c6739282b0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-11a0af0d-049c-4dc3-a9c0-3492c333e626 tempest-VolumesGetTest-886688485 None] Acquiring lock "cinder-quobyte-572a007f-b9dc-44fa-8507-09c6739282b0" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-11a0af0d-049c-4dc3-a9c0-3492c333e626 tempest-VolumesGetTest-886688485 None] Lock "cinder-quobyte-572a007f-b9dc-44fa-8507-09c6739282b0" acquired by "delete_volume" :: waited 0.028s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:14 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:14 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12a05d5-befc-4627-9e93-0db979d296b2]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-11a0af0d-049c-4dc3-a9c0-3492c333e626 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-572a007f-b9dc-44fa-8507-09c6739282b0 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-be42a224-18f0-46d7-9cd1-f5062f0d728f tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.414s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:14 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-be42a224-18f0-46d7-9cd1-f5062f0d728f tempest-VolumesGetTest-886688485 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:57:14 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-be42a224-18f0-46d7-9cd1-f5062f0d728f tempest-VolumesGetTest-886688485 None] Deleted volume successfully.
Sep 04 15:57:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-be42a224-18f0-46d7-9cd1-f5062f0d728f tempest-VolumesGetTest-886688485 None] Lock "cinder-27ab14f0-9fd8-4b73-8bd0-795d5fc0d73e-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:14 devstack sudo[98591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-572a007f-b9dc-44fa-8507-09c6739282b0
Sep 04 15:57:14 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:15 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-11a0af0d-049c-4dc3-a9c0-3492c333e626 tempest-VolumesGetTest-886688485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-572a007f-b9dc-44fa-8507-09c6739282b0" returned: 0 in 0.500s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-11a0af0d-049c-4dc3-a9c0-3492c333e626 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-572a007f-b9dc-44fa-8507-09c6739282b0 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:15 devstack sudo[98596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-572a007f-b9dc-44fa-8507-09c6739282b0
Sep 04 15:57:15 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:15 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-06a3721f-a45e-41e2-8819-92d66bf13efd tempest-VolumesTransfersV355Test-856736857 None] Transfer volume completed successfully.
Sep 04 15:57:15 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-11a0af0d-049c-4dc3-a9c0-3492c333e626 tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-572a007f-b9dc-44fa-8507-09c6739282b0" returned: 0 in 0.417s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-11a0af0d-049c-4dc3-a9c0-3492c333e626 tempest-VolumesGetTest-886688485 None] Lock "cinder-quobyte-572a007f-b9dc-44fa-8507-09c6739282b0" released by "delete_volume" :: held 0.990s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:15 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-11a0af0d-049c-4dc3-a9c0-3492c333e626 tempest-VolumesGetTest-886688485 None] Created reservations ['45a0aa79-44ff-4a46-ba95-1698b5b1ecd7', '1b92000b-eaa0-4c7c-84f9-429e58ae0a7f', 'cf2c7bad-09da-47ab-b09f-6eda9f0caf32', 'f28b3a44-dfcc-4529-83c0-8e92805c3001'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:57:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-11a0af0d-049c-4dc3-a9c0-3492c333e626 tempest-VolumesGetTest-886688485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-11a0af0d-049c-4dc3-a9c0-3492c333e626 tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:15 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-11a0af0d-049c-4dc3-a9c0-3492c333e626 tempest-VolumesGetTest-886688485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:15 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-11a0af0d-049c-4dc3-a9c0-3492c333e626 tempest-VolumesGetTest-886688485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-11a0af0d-049c-4dc3-a9c0-3492c333e626 tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-11a0af0d-049c-4dc3-a9c0-3492c333e626 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:15 devstack sudo[98599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:57:15 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:16 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4ce51011-9205-41c4-b0f6-1ae80e02d7ae tempest-AttachVolumeTestJSON-1246579971 None] Acquiring lock "cinder-7ee882ec-ba9c-49c2-b0c7-597b03377b35-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-11a0af0d-049c-4dc3-a9c0-3492c333e626 tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.318s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:16 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-11a0af0d-049c-4dc3-a9c0-3492c333e626 tempest-VolumesGetTest-886688485 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:57:16 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-11a0af0d-049c-4dc3-a9c0-3492c333e626 tempest-VolumesGetTest-886688485 None] Deleted volume successfully.
Sep 04 15:57:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4ce51011-9205-41c4-b0f6-1ae80e02d7ae tempest-AttachVolumeTestJSON-1246579971 None] Lock "cinder-7ee882ec-ba9c-49c2-b0c7-597b03377b35-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-11a0af0d-049c-4dc3-a9c0-3492c333e626 tempest-VolumesGetTest-886688485 None] Lock "cinder-572a007f-b9dc-44fa-8507-09c6739282b0-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4ce51011-9205-41c4-b0f6-1ae80e02d7ae tempest-AttachVolumeTestJSON-1246579971 None] Acquiring lock "cinder-quobyte-7ee882ec-ba9c-49c2-b0c7-597b03377b35" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4ce51011-9205-41c4-b0f6-1ae80e02d7ae tempest-AttachVolumeTestJSON-1246579971 None] Lock "cinder-quobyte-7ee882ec-ba9c-49c2-b0c7-597b03377b35" acquired by "delete_volume" :: waited 0.016s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:16 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0da498-01ec-43b2-9a23-658fd9912dcb]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4ce51011-9205-41c4-b0f6-1ae80e02d7ae tempest-AttachVolumeTestJSON-1246579971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7ee882ec-ba9c-49c2-b0c7-597b03377b35 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e1aef5a8-371d-4dd8-afa6-332889baf185 tempest-VolumesTransfersV355Test-1210122263 None] Acquiring lock "cinder-4e2ffe1d-41b5-4631-b552-dac3cbc48a6a-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e1aef5a8-371d-4dd8-afa6-332889baf185 tempest-VolumesTransfersV355Test-1210122263 None] Lock "cinder-4e2ffe1d-41b5-4631-b552-dac3cbc48a6a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e1aef5a8-371d-4dd8-afa6-332889baf185 tempest-VolumesTransfersV355Test-1210122263 None] Acquiring lock "cinder-quobyte-4e2ffe1d-41b5-4631-b552-dac3cbc48a6a" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e1aef5a8-371d-4dd8-afa6-332889baf185 tempest-VolumesTransfersV355Test-1210122263 None] Lock "cinder-quobyte-4e2ffe1d-41b5-4631-b552-dac3cbc48a6a" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:16 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bed188-afec-40fc-93e7-9b19fafdc24f]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e1aef5a8-371d-4dd8-afa6-332889baf185 tempest-VolumesTransfersV355Test-1210122263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4e2ffe1d-41b5-4631-b552-dac3cbc48a6a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:16 devstack sudo[98602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7ee882ec-ba9c-49c2-b0c7-597b03377b35
Sep 04 15:57:16 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:16 devstack sudo[98604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4e2ffe1d-41b5-4631-b552-dac3cbc48a6a
Sep 04 15:57:16 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:16 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4ce51011-9205-41c4-b0f6-1ae80e02d7ae tempest-AttachVolumeTestJSON-1246579971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7ee882ec-ba9c-49c2-b0c7-597b03377b35" returned: 0 in 0.424s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4ce51011-9205-41c4-b0f6-1ae80e02d7ae tempest-AttachVolumeTestJSON-1246579971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7ee882ec-ba9c-49c2-b0c7-597b03377b35 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:16 devstack sudo[98609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7ee882ec-ba9c-49c2-b0c7-597b03377b35
Sep 04 15:57:16 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:16 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e1aef5a8-371d-4dd8-afa6-332889baf185 tempest-VolumesTransfersV355Test-1210122263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4e2ffe1d-41b5-4631-b552-dac3cbc48a6a" returned: 0 in 0.436s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e1aef5a8-371d-4dd8-afa6-332889baf185 tempest-VolumesTransfersV355Test-1210122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4e2ffe1d-41b5-4631-b552-dac3cbc48a6a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:16 devstack sudo[98614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4e2ffe1d-41b5-4631-b552-dac3cbc48a6a
Sep 04 15:57:16 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:16 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4ce51011-9205-41c4-b0f6-1ae80e02d7ae tempest-AttachVolumeTestJSON-1246579971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7ee882ec-ba9c-49c2-b0c7-597b03377b35" returned: 0 in 0.304s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4ce51011-9205-41c4-b0f6-1ae80e02d7ae tempest-AttachVolumeTestJSON-1246579971 None] Lock "cinder-quobyte-7ee882ec-ba9c-49c2-b0c7-597b03377b35" released by "delete_volume" :: held 0.785s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-4ce51011-9205-41c4-b0f6-1ae80e02d7ae tempest-AttachVolumeTestJSON-1246579971 None] Created reservations ['41da1885-4993-4c58-97e9-aef07c7807c6', 'fc896134-46a8-441d-bf40-d461c1d4f1d5', '6f9a20d5-1cc6-45b6-99c0-6c1d2fc5abd7', '666db2f9-b8a0-45d0-ae9c-a2f157f02734'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:57:17 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e1aef5a8-371d-4dd8-afa6-332889baf185 tempest-VolumesTransfersV355Test-1210122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4e2ffe1d-41b5-4631-b552-dac3cbc48a6a" returned: 0 in 0.290s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e1aef5a8-371d-4dd8-afa6-332889baf185 tempest-VolumesTransfersV355Test-1210122263 None] Lock "cinder-quobyte-4e2ffe1d-41b5-4631-b552-dac3cbc48a6a" released by "delete_volume" :: held 0.788s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4ce51011-9205-41c4-b0f6-1ae80e02d7ae tempest-AttachVolumeTestJSON-1246579971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4ce51011-9205-41c4-b0f6-1ae80e02d7ae tempest-AttachVolumeTestJSON-1246579971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4ce51011-9205-41c4-b0f6-1ae80e02d7ae tempest-AttachVolumeTestJSON-1246579971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4ce51011-9205-41c4-b0f6-1ae80e02d7ae tempest-AttachVolumeTestJSON-1246579971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4ce51011-9205-41c4-b0f6-1ae80e02d7ae tempest-AttachVolumeTestJSON-1246579971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4ce51011-9205-41c4-b0f6-1ae80e02d7ae tempest-AttachVolumeTestJSON-1246579971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:17 devstack sudo[98618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:57:17 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-e1aef5a8-371d-4dd8-afa6-332889baf185 tempest-VolumesTransfersV355Test-1210122263 None] Created reservations ['8561f1bd-85e2-4bff-9962-02e77be3e398', '08bb40e0-6840-41f7-8931-a359e047e52d', 'b9fa667a-577a-4651-86bd-e119700643d6', '7e02262d-940b-4824-a3b6-af52bfae48d8'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-93600c0b-02e9-40b2-a050-7a6095f13296 tempest-AttachVolumeTestJSON-1246579971 None] Acquiring lock "cinder-002503db-ac6e-4ded-b0b3-0dfc0150cc40-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-93600c0b-02e9-40b2-a050-7a6095f13296 tempest-AttachVolumeTestJSON-1246579971 None] Lock "cinder-002503db-ac6e-4ded-b0b3-0dfc0150cc40-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e1aef5a8-371d-4dd8-afa6-332889baf185 tempest-VolumesTransfersV355Test-1210122263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e1aef5a8-371d-4dd8-afa6-332889baf185 tempest-VolumesTransfersV355Test-1210122263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e1aef5a8-371d-4dd8-afa6-332889baf185 tempest-VolumesTransfersV355Test-1210122263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e1aef5a8-371d-4dd8-afa6-332889baf185 tempest-VolumesTransfersV355Test-1210122263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e1aef5a8-371d-4dd8-afa6-332889baf185 tempest-VolumesTransfersV355Test-1210122263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e1aef5a8-371d-4dd8-afa6-332889baf185 tempest-VolumesTransfersV355Test-1210122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-93600c0b-02e9-40b2-a050-7a6095f13296 tempest-AttachVolumeTestJSON-1246579971 None] Acquiring lock "cinder-quobyte-002503db-ac6e-4ded-b0b3-0dfc0150cc40" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:17 devstack sudo[98620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:57:17 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Flow 'volume_create_manager' (0360d33f-eb2a-4390-86a1-4fbfb023eb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d352e5-0975-41bc-8240-20f497963853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-93600c0b-02e9-40b2-a050-7a6095f13296 tempest-AttachVolumeTestJSON-1246579971 None] Lock "cinder-quobyte-002503db-ac6e-4ded-b0b3-0dfc0150cc40" acquired by "delete_volume" :: waited 0.100s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:17 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d352e5-0975-41bc-8240-20f497963853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-254671444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0533d20d-e7c7-4b2a-a1b0-7a86729b3a43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6c277473a44f819a2785f8e459d058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:17Z,use_quota=True,user_id='71aaedd9a29b44df9edb60fbb98be877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (564e109f-c53b-47c9-9c92-cbeefc0fdd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (564e109f-c53b-47c9-9c92-cbeefc0fdd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc6de91-953d-4a0d-b3b1-2708ce881003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc6de91-953d-4a0d-b3b1-2708ce881003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0533d20d-e7c7-4b2a-a1b0-7a86729b3a43', 'volume_name': 'volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89055dbb-226f-4a64-84cd-df6f61e31277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89055dbb-226f-4a64-84cd-df6f61e31277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2aa930-8a5d-448d-a6a7-76b1d3cbb44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:17 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Volume 0533d20d-e7c7-4b2a-a1b0-7a86729b3a43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43', 'volume_size': 1}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-254671444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0533d20d-e7c7-4b2a-a1b0-7a86729b3a43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6c277473a44f819a2785f8e459d058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:17Z,use_quota=True,user_id='71aaedd9a29b44df9edb60fbb98be877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Creating volume 0533d20d-e7c7-4b2a-a1b0-7a86729b3a43 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:57:17 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[739d212e-c89e-4834-a43e-62fedf61a71d]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-93600c0b-02e9-40b2-a050-7a6095f13296 tempest-AttachVolumeTestJSON-1246579971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-002503db-ac6e-4ded-b0b3-0dfc0150cc40 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4ce51011-9205-41c4-b0f6-1ae80e02d7ae tempest-AttachVolumeTestJSON-1246579971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.589s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-4ce51011-9205-41c4-b0f6-1ae80e02d7ae tempest-AttachVolumeTestJSON-1246579971 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:57:17 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-4ce51011-9205-41c4-b0f6-1ae80e02d7ae tempest-AttachVolumeTestJSON-1246579971 None] Deleted volume successfully.
Sep 04 15:57:17 devstack sudo[98623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43 1073741824
Sep 04 15:57:17 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:17 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4ce51011-9205-41c4-b0f6-1ae80e02d7ae tempest-AttachVolumeTestJSON-1246579971 None] Lock "cinder-7ee882ec-ba9c-49c2-b0c7-597b03377b35-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e1aef5a8-371d-4dd8-afa6-332889baf185 tempest-VolumesTransfersV355Test-1210122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.346s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-e1aef5a8-371d-4dd8-afa6-332889baf185 tempest-VolumesTransfersV355Test-1210122263 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:57:17 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e1aef5a8-371d-4dd8-afa6-332889baf185 tempest-VolumesTransfersV355Test-1210122263 None] Deleted volume successfully.
Sep 04 15:57:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e1aef5a8-371d-4dd8-afa6-332889baf185 tempest-VolumesTransfersV355Test-1210122263 None] Lock "cinder-4e2ffe1d-41b5-4631-b552-dac3cbc48a6a-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:17 devstack sudo[98624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-002503db-ac6e-4ded-b0b3-0dfc0150cc40
Sep 04 15:57:17 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Flow 'volume_create_manager' (1c666b6b-d2a9-4c2f-870b-0ae407c06b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6726b1-c473-4cd8-b56e-a1c41ed1338c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:18 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6726b1-c473-4cd8-b56e-a1c41ed1338c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-430118880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33c87020-6aa9-403e-8827-6846a3a0c201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7d00f7b00f40baaacb359d4cefa28d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:18Z,use_quota=True,user_id='90d53049303e48ab804accf5026205fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95624b68-be93-4063-9062-5708c3ed5d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95624b68-be93-4063-9062-5708c3ed5d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884bcfae-8eaa-444e-ad8d-d64aa2652ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884bcfae-8eaa-444e-ad8d-d64aa2652ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33c87020-6aa9-403e-8827-6846a3a0c201', 'volume_name': 'volume-33c87020-6aa9-403e-8827-6846a3a0c201', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126a688d-f4ae-4871-95f7-2ae9639ab855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126a688d-f4ae-4871-95f7-2ae9639ab855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc63a45-ad10-4bec-9e70-e25c1d28cc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:18 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Volume 33c87020-6aa9-403e-8827-6846a3a0c201: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33c87020-6aa9-403e-8827-6846a3a0c201', 'volume_size': 1}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-93600c0b-02e9-40b2-a050-7a6095f13296 tempest-AttachVolumeTestJSON-1246579971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-002503db-ac6e-4ded-b0b3-0dfc0150cc40" returned: 0 in 0.508s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-93600c0b-02e9-40b2-a050-7a6095f13296 tempest-AttachVolumeTestJSON-1246579971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-002503db-ac6e-4ded-b0b3-0dfc0150cc40 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:18 devstack sudo[98634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-002503db-ac6e-4ded-b0b3-0dfc0150cc40
Sep 04 15:57:18 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:18 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43 1073741824" returned: 0 in 0.688s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:18 devstack sudo[98637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43
Sep 04 15:57:18 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:18 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-93600c0b-02e9-40b2-a050-7a6095f13296 tempest-AttachVolumeTestJSON-1246579971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-002503db-ac6e-4ded-b0b3-0dfc0150cc40" returned: 0 in 0.331s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-93600c0b-02e9-40b2-a050-7a6095f13296 tempest-AttachVolumeTestJSON-1246579971 None] Lock "cinder-quobyte-002503db-ac6e-4ded-b0b3-0dfc0150cc40" released by "delete_volume" :: held 1.010s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-93600c0b-02e9-40b2-a050-7a6095f13296 tempest-AttachVolumeTestJSON-1246579971 None] Created reservations ['933fb820-0b40-4824-9bd7-8e51ed3abfde', '4bbae52f-ef54-40f9-83e6-839d1d9ffb57', 'f0e09356-83c3-4090-b34a-c89bbd830113', '8ddc2e22-0439-44f5-84ad-01a922107f83'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-93600c0b-02e9-40b2-a050-7a6095f13296 tempest-AttachVolumeTestJSON-1246579971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-93600c0b-02e9-40b2-a050-7a6095f13296 tempest-AttachVolumeTestJSON-1246579971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-93600c0b-02e9-40b2-a050-7a6095f13296 tempest-AttachVolumeTestJSON-1246579971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-93600c0b-02e9-40b2-a050-7a6095f13296 tempest-AttachVolumeTestJSON-1246579971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-93600c0b-02e9-40b2-a050-7a6095f13296 tempest-AttachVolumeTestJSON-1246579971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-93600c0b-02e9-40b2-a050-7a6095f13296 tempest-AttachVolumeTestJSON-1246579971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:18 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43" returned: 0 in 0.337s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:18 devstack sudo[98647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:57:18 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.543s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-430118880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33c87020-6aa9-403e-8827-6846a3a0c201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7d00f7b00f40baaacb359d4cefa28d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:18Z,use_quota=True,user_id='90d53049303e48ab804accf5026205fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Creating volume 33c87020-6aa9-403e-8827-6846a3a0c201 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:57:18 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-33c87020-6aa9-403e-8827-6846a3a0c201 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2aa930-8a5d-448d-a6a7-76b1d3cbb44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:18 devstack sudo[98649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-33c87020-6aa9-403e-8827-6846a3a0c201 1073741824
Sep 04 15:57:18 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (161f9877-fb05-4a38-9e1b-6e4215c1fb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:18 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Volume volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43 (0533d20d-e7c7-4b2a-a1b0-7a86729b3a43): created successfully
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (161f9877-fb05-4a38-9e1b-6e4215c1fb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Flow 'volume_create_manager' (0360d33f-eb2a-4390-86a1-4fbfb023eb74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:18 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-5221937d-b6bd-4f96-a193-c4d149b4e706 tempest-VolumesGetTest-886688485 None] Created volume successfully.
Sep 04 15:57:19 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-93600c0b-02e9-40b2-a050-7a6095f13296 tempest-AttachVolumeTestJSON-1246579971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.310s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:19 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-93600c0b-02e9-40b2-a050-7a6095f13296 tempest-AttachVolumeTestJSON-1246579971 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:57:19 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-93600c0b-02e9-40b2-a050-7a6095f13296 tempest-AttachVolumeTestJSON-1246579971 None] Deleted volume successfully.
Sep 04 15:57:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-93600c0b-02e9-40b2-a050-7a6095f13296 tempest-AttachVolumeTestJSON-1246579971 None] Lock "cinder-002503db-ac6e-4ded-b0b3-0dfc0150cc40-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:19 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-33c87020-6aa9-403e-8827-6846a3a0c201 1073741824" returned: 0 in 0.495s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-33c87020-6aa9-403e-8827-6846a3a0c201 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:19 devstack sudo[98657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-33c87020-6aa9-403e-8827-6846a3a0c201
Sep 04 15:57:19 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:19 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-33c87020-6aa9-403e-8827-6846a3a0c201" returned: 0 in 0.311s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:19 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:57:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:19 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc63a45-ad10-4bec-9e70-e25c1d28cc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33c87020-6aa9-403e-8827-6846a3a0c201', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:19 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7400c42-d78f-4252-a6f8-fdc9d7a4e1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:19 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Volume volume-33c87020-6aa9-403e-8827-6846a3a0c201 (33c87020-6aa9-403e-8827-6846a3a0c201): created successfully
Sep 04 15:57:19 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7400c42-d78f-4252-a6f8-fdc9d7a4e1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:19 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Flow 'volume_create_manager' (1c666b6b-d2a9-4c2f-870b-0ae407c06b6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:19 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-d9f2da60-3d19-4735-bca9-0036e19d96ad tempest-VolumesTransfersV355Test-680018593 None] Created volume successfully.
Sep 04 15:57:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4c5ca715-7bde-40fb-b664-df222c098829 tempest-AttachVolumeTestJSON-1246579971 None] Acquiring lock "cinder-07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4c5ca715-7bde-40fb-b664-df222c098829 tempest-AttachVolumeTestJSON-1246579971 None] Lock "cinder-07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4c5ca715-7bde-40fb-b664-df222c098829 tempest-AttachVolumeTestJSON-1246579971 None] Acquiring lock "cinder-quobyte-07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4c5ca715-7bde-40fb-b664-df222c098829 tempest-AttachVolumeTestJSON-1246579971 None] Lock "cinder-quobyte-07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6" acquired by "delete_volume" :: waited 0.025s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:19 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[518ff022-78a9-4aea-95a4-b4e7521fb873]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4c5ca715-7bde-40fb-b664-df222c098829 tempest-AttachVolumeTestJSON-1246579971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:20 devstack sudo[98660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6
Sep 04 15:57:20 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Flow 'volume_create_manager' (e23c6be5-d463-4729-8742-7c3d6b2d2a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64be88ef-5682-44c5-90c7-6e76f43ab861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64be88ef-5682-44c5-90c7-6e76f43ab861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2039923612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd46e3c0-99c3-408c-8308-f7a62a0c9ec1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4b6c277473a44f819a2785f8e459d058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=0533d20d-e7c7-4b2a-a1b0-7a86729b3a43,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:20Z,use_quota=True,user_id='71aaedd9a29b44df9edb60fbb98be877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca74159-57e5-40ff-bd66-57a646bd4fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca74159-57e5-40ff-bd66-57a646bd4fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb601c06-b425-415e-ad14-c4655298d09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb601c06-b425-415e-ad14-c4655298d09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bd46e3c0-99c3-408c-8308-f7a62a0c9ec1', 'volume_name': 'volume-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1', 'volume_size': 1, 'source_volid': '0533d20d-e7c7-4b2a-a1b0-7a86729b3a43', 'source_volstatus': 'available'}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de5ba3c-38b1-4124-b4d3-faddeb6b3133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de5ba3c-38b1-4124-b4d3-faddeb6b3133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (805c382e-e66f-4edd-83d4-5a56088f4637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:20 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Volume bd46e3c0-99c3-408c-8308-f7a62a0c9ec1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1', 'volume_size': 1, 'source_volid': '0533d20d-e7c7-4b2a-a1b0-7a86729b3a43', 'source_volstatus': 'available'}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:20 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Cloning volume 0533d20d-e7c7-4b2a-a1b0-7a86729b3a43 to volume bd46e3c0-99c3-408c-8308-f7a62a0c9ec1
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Creating offline snapshot 4147988f-a376-43f1-b494-97d679b56d81 of volume 0533d20d-e7c7-4b2a-a1b0-7a86729b3a43 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:57:20 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4c5ca715-7bde-40fb-b664-df222c098829 tempest-AttachVolumeTestJSON-1246579971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6" returned: 0 in 0.452s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4c5ca715-7bde-40fb-b664-df222c098829 tempest-AttachVolumeTestJSON-1246579971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68ea6a2-034e-4476-9139-119e8ef1bb34]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:20 devstack sudo[98667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6
Sep 04 15:57:20 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:20 devstack sudo[98668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43
Sep 04 15:57:20 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:20 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4c5ca715-7bde-40fb-b664-df222c098829 tempest-AttachVolumeTestJSON-1246579971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6" returned: 0 in 0.295s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4c5ca715-7bde-40fb-b664-df222c098829 tempest-AttachVolumeTestJSON-1246579971 None] Lock "cinder-quobyte-07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6" released by "delete_volume" :: held 0.810s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5e6a1b80-a7bd-40d0-a43b-3f1f95f641a0 tempest-VolumesTransfersV355Test-1210122263 None] Acquiring lock "cinder-33c87020-6aa9-403e-8827-6846a3a0c201-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5e6a1b80-a7bd-40d0-a43b-3f1f95f641a0 tempest-VolumesTransfersV355Test-1210122263 None] Lock "cinder-33c87020-6aa9-403e-8827-6846a3a0c201-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5e6a1b80-a7bd-40d0-a43b-3f1f95f641a0 tempest-VolumesTransfersV355Test-1210122263 None] Acquiring lock "cinder-quobyte-33c87020-6aa9-403e-8827-6846a3a0c201" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-4c5ca715-7bde-40fb-b664-df222c098829 tempest-AttachVolumeTestJSON-1246579971 None] Created reservations ['970081af-117f-4c24-b4a1-11f24bd69bde', '1606c25d-c335-47e4-9f0f-e613259a91fc', 'f892e2e6-e0ce-413b-9658-38b3d5aeda9f', '62c3634e-a90c-418b-8fb7-b2230207ccf7'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5e6a1b80-a7bd-40d0-a43b-3f1f95f641a0 tempest-VolumesTransfersV355Test-1210122263 None] Lock "cinder-quobyte-33c87020-6aa9-403e-8827-6846a3a0c201" acquired by "delete_volume" :: waited 0.030s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8eb97e-1304-4b61-9c26-43d2d4272f63]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:20 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5e6a1b80-a7bd-40d0-a43b-3f1f95f641a0 tempest-VolumesTransfersV355Test-1210122263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-33c87020-6aa9-403e-8827-6846a3a0c201 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43" returned: 0 in 0.481s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.4147988f-a376-43f1-b494-97d679b56d81 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:20 devstack sudo[98676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.4147988f-a376-43f1-b494-97d679b56d81 1G
Sep 04 15:57:20 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4c5ca715-7bde-40fb-b664-df222c098829 tempest-AttachVolumeTestJSON-1246579971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4c5ca715-7bde-40fb-b664-df222c098829 tempest-AttachVolumeTestJSON-1246579971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4c5ca715-7bde-40fb-b664-df222c098829 tempest-AttachVolumeTestJSON-1246579971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4c5ca715-7bde-40fb-b664-df222c098829 tempest-AttachVolumeTestJSON-1246579971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4c5ca715-7bde-40fb-b664-df222c098829 tempest-AttachVolumeTestJSON-1246579971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4c5ca715-7bde-40fb-b664-df222c098829 tempest-AttachVolumeTestJSON-1246579971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:20 devstack sudo[98678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:57:20 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:21 devstack sudo[98675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-33c87020-6aa9-403e-8827-6846a3a0c201
Sep 04 15:57:21 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:21 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4c5ca715-7bde-40fb-b664-df222c098829 tempest-AttachVolumeTestJSON-1246579971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.340s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:21 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-4c5ca715-7bde-40fb-b664-df222c098829 tempest-AttachVolumeTestJSON-1246579971 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:57:21 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-4c5ca715-7bde-40fb-b664-df222c098829 tempest-AttachVolumeTestJSON-1246579971 None] Deleted volume successfully.
Sep 04 15:57:21 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4c5ca715-7bde-40fb-b664-df222c098829 tempest-AttachVolumeTestJSON-1246579971 None] Lock "cinder-07e060cc-3e91-4761-b1a7-e9d2bc0ac0b6-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5e6a1b80-a7bd-40d0-a43b-3f1f95f641a0 tempest-VolumesTransfersV355Test-1210122263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-33c87020-6aa9-403e-8827-6846a3a0c201" returned: 0 in 0.492s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5e6a1b80-a7bd-40d0-a43b-3f1f95f641a0 tempest-VolumesTransfersV355Test-1210122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-33c87020-6aa9-403e-8827-6846a3a0c201 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:21 devstack sudo[98689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-33c87020-6aa9-403e-8827-6846a3a0c201
Sep 04 15:57:21 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:21 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.4147988f-a376-43f1-b494-97d679b56d81 1G" returned: 0 in 0.614s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.4147988f-a376-43f1-b494-97d679b56d81 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:21 devstack sudo[98692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.4147988f-a376-43f1-b494-97d679b56d81
Sep 04 15:57:21 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:21 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5e6a1b80-a7bd-40d0-a43b-3f1f95f641a0 tempest-VolumesTransfersV355Test-1210122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-33c87020-6aa9-403e-8827-6846a3a0c201" returned: 0 in 0.330s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5e6a1b80-a7bd-40d0-a43b-3f1f95f641a0 tempest-VolumesTransfersV355Test-1210122263 None] Lock "cinder-quobyte-33c87020-6aa9-403e-8827-6846a3a0c201" released by "delete_volume" :: held 0.877s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:21 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-5e6a1b80-a7bd-40d0-a43b-3f1f95f641a0 tempest-VolumesTransfersV355Test-1210122263 None] Created reservations ['406e748a-1416-42e7-b8b6-6862be4594f9', '73d95a5f-6558-43c5-9892-e3e713efa22c', 'e2a2d0b6-4fcb-477e-a1c1-5cc0a7d9bb26', '8b9d47bf-c77b-45e2-bda5-630a2d3df39a'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:57:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5e6a1b80-a7bd-40d0-a43b-3f1f95f641a0 tempest-VolumesTransfersV355Test-1210122263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5e6a1b80-a7bd-40d0-a43b-3f1f95f641a0 tempest-VolumesTransfersV355Test-1210122263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5e6a1b80-a7bd-40d0-a43b-3f1f95f641a0 tempest-VolumesTransfersV355Test-1210122263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:21 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5e6a1b80-a7bd-40d0-a43b-3f1f95f641a0 tempest-VolumesTransfersV355Test-1210122263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5e6a1b80-a7bd-40d0-a43b-3f1f95f641a0 tempest-VolumesTransfersV355Test-1210122263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5e6a1b80-a7bd-40d0-a43b-3f1f95f641a0 tempest-VolumesTransfersV355Test-1210122263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.4147988f-a376-43f1-b494-97d679b56d81" returned: 0 in 0.405s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:21 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.4147988f-a376-43f1-b494-97d679b56d81 is being set with open permissions: ugo+rw
Sep 04 15:57:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.4147988f-a376-43f1-b494-97d679b56d81 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:21 devstack sudo[98700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:57:21 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:21 devstack sudo[98701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.4147988f-a376-43f1-b494-97d679b56d81
Sep 04 15:57:21 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:22 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.4147988f-a376-43f1-b494-97d679b56d81" returned: 0 in 0.389s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:22 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5e6a1b80-a7bd-40d0-a43b-3f1f95f641a0 tempest-VolumesTransfersV355Test-1210122263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.474s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:22 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-5e6a1b80-a7bd-40d0-a43b-3f1f95f641a0 tempest-VolumesTransfersV355Test-1210122263 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:57:22 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-5e6a1b80-a7bd-40d0-a43b-3f1f95f641a0 tempest-VolumesTransfersV355Test-1210122263 None] Deleted volume successfully.
Sep 04 15:57:22 devstack sudo[98706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.info
Sep 04 15:57:22 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5e6a1b80-a7bd-40d0-a43b-3f1f95f641a0 tempest-VolumesTransfersV355Test-1210122263 None] Lock "cinder-33c87020-6aa9-403e-8827-6846a3a0c201-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:22 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f888bf46-db2a-443a-a052-bc22ccfd52ec tempest-GroupsV314Test-320423269 None] Group tempest-GroupsV314Test-Group-1212504631: creating
Sep 04 15:57:22 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f888bf46-db2a-443a-a052-bc22ccfd52ec tempest-GroupsV314Test-320423269 None] Group tempest-GroupsV314Test-Group-1212504631: created successfully
Sep 04 15:57:22 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f888bf46-db2a-443a-a052-bc22ccfd52ec tempest-GroupsV314Test-320423269 None] Create group completed successfully.
Sep 04 15:57:22 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.info" returned: 0 in 0.382s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:22 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.info is being set with open permissions: ugo+rw
Sep 04 15:57:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:22 devstack sudo[98709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.info
Sep 04 15:57:22 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:23 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.info" returned: 0 in 0.274s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Acquiring lock "cinder-quobyte-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1" by "_copy_volume_from_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Lock "cinder-quobyte-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] snapshot: 4147988f-a376-43f1-b494-97d679b56d81, volume: bd46e3c0-99c3-408c-8308-f7a62a0c9ec1,  {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 04 15:57:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:23 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2b2070-c6f9-4581-a0d8-6875a1a4ebc6]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.4147988f-a376-43f1-b494-97d679b56d81 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:23 devstack sudo[98713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.4147988f-a376-43f1-b494-97d679b56d81
Sep 04 15:57:23 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:23 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.4147988f-a376-43f1-b494-97d679b56d81" returned: 0 in 0.462s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:57:23 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d799c524-1a8b-4e10-89ce-c46078654a5a]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:23 devstack sudo[98718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43
Sep 04 15:57:23 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:24 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43" returned: 0 in 0.452s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:24 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43 {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 04 15:57:24 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Creating direct copy from snapshot {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 04 15:57:24 devstack cinder-volume[87504]: DEBUG cinder.utils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Path /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1 not found in is_blk_device check {{(pid=87504) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 04 15:57:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:24 devstack sudo[98724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1
Sep 04 15:57:24 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:24 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:57:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Flow 'volume_create_manager' (4c27c9b6-edf0-4637-99ab-5a73b58e70f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb866fc-f699-47a3-bacd-deb21c156e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb866fc-f699-47a3-bacd-deb21c156e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-336532949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1d428326-b2ac-4eef-9bc3-d21f53d8d136,host='devstack@QuobyteHD#QuobyteHD',id=2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e710feb3c046debff23963331c7bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:25Z,use_quota=True,user_id='a08ae2d04d36445cbbb32ce4121904e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c62927-8082-4ed5-8b97-b6aed7dcce74),volume_type_id=b4c62927-8082-4ed5-8b97-b6aed7dcce74)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981eb06e-02a6-4865-b456-34a570518bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981eb06e-02a6-4865-b456-34a570518bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a1b79de-ab25-41e9-82e7-b74a3ecd17e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a1b79de-ab25-41e9-82e7-b74a3ecd17e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e', 'volume_name': 'volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71dec5b0-ad01-4972-997a-7111d905e681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71dec5b0-ad01-4972-997a-7111d905e681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d44efc74-fdbb-4b74-a4f4-44a53831a40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:24 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Volume 2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e', 'volume_size': 1}
Sep 04 15:57:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:30 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1" returned: 0 in 6.168s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:30 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43, size 1024.00 MB, duration 6.17 sec, destination /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1 {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 15:57:30 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Converted 1024.00 MB image at 165.99 MB/s
Sep 04 15:57:30 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1 is being set with open permissions: ugo+rw
Sep 04 15:57:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:30 devstack sudo[98737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1
Sep 04 15:57:30 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:30 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1" returned: 0 in 0.364s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:30 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Lock "cinder-quobyte-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1" released by "_copy_volume_from_snapshot" :: held 7.548s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:30 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Acquiring lock "cinder-quobyte-4147988f-a376-43f1-b494-97d679b56d81" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:30 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Lock "cinder-quobyte-4147988f-a376-43f1-b494-97d679b56d81" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:30 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Deleting offline snapshot 4147988f-a376-43f1-b494-97d679b56d81 of volume 0533d20d-e7c7-4b2a-a1b0-7a86729b3a43 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 15:57:30 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] snapshot_file for this snap is: volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.4147988f-a376-43f1-b494-97d679b56d81 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 15:57:30 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb44352-58df-4988-8e81-648127d05a68]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.4147988f-a376-43f1-b494-97d679b56d81 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:30 devstack sudo[98740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.4147988f-a376-43f1-b494-97d679b56d81
Sep 04 15:57:30 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:31 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.4147988f-a376-43f1-b494-97d679b56d81" returned: 0 in 0.444s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:57:31 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8495999e-5b00-4287-b422-a650b49253a6]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:31 devstack sudo[98746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43
Sep 04 15:57:31 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:31 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43" returned: 0 in 0.606s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.4147988f-a376-43f1-b494-97d679b56d81 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:31 devstack sudo[98752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.4147988f-a376-43f1-b494-97d679b56d81
Sep 04 15:57:31 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:32 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.4147988f-a376-43f1-b494-97d679b56d81" returned: 0 in 0.399s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.4147988f-a376-43f1-b494-97d679b56d81 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:32 devstack sudo[98757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.4147988f-a376-43f1-b494-97d679b56d81
Sep 04 15:57:32 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:32 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43.4147988f-a376-43f1-b494-97d679b56d81" returned: 0 in 0.267s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:32 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Lock "cinder-quobyte-4147988f-a376-43f1-b494-97d679b56d81" released by "_delete_snapshot" :: held 1.854s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.244s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.769s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:32 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1d428326-b2ac-4eef-9bc3-d21f53d8d136,created_at=2026-09-04T13:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-336532949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1d428326-b2ac-4eef-9bc3-d21f53d8d136,host='devstack@QuobyteHD#QuobyteHD',id=2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e710feb3c046debff23963331c7bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:25Z,use_quota=True,user_id='a08ae2d04d36445cbbb32ce4121904e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c62927-8082-4ed5-8b97-b6aed7dcce74),volume_type_id=b4c62927-8082-4ed5-8b97-b6aed7dcce74)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:57:32 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Creating volume 2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:57:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:32 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:32 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:32 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:57:32 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:57:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:32 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (805c382e-e66f-4edd-83d4-5a56088f4637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1', 'volume_size': 1, 'source_volid': '0533d20d-e7c7-4b2a-a1b0-7a86729b3a43', 'source_volstatus': 'available'}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:32 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af188942-02a2-40d4-b349-88413b151d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:32 devstack sudo[98760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e 1073741824
Sep 04 15:57:32 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:32 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Volume volume-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1 (bd46e3c0-99c3-408c-8308-f7a62a0c9ec1): created successfully
Sep 04 15:57:32 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af188942-02a2-40d4-b349-88413b151d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:32 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Flow 'volume_create_manager' (e23c6be5-d463-4729-8742-7c3d6b2d2a25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:32 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-bda3964a-4728-4dd0-8114-bbf4b7e0f106 tempest-VolumesGetTest-886688485 None] Created volume successfully.
Sep 04 15:57:33 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e 1073741824" returned: 0 in 0.659s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:33 devstack sudo[98765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e
Sep 04 15:57:33 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:33 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:57:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Flow 'volume_create_manager' (e1c2990c-6be8-4443-9dbb-4dd68734b775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b9471a-b000-4c2c-884c-34613370e7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b9471a-b000-4c2c-884c-34613370e7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-937206113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6887e6f-45ff-4bbb-920c-f0cf1c634f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf4942e362e4e80b9e67cd0f8c8fa7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:33Z,use_quota=True,user_id='90d5e85a72624a96955885229bac933b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a484e6-4088-4928-89b5-174f5e435627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a484e6-4088-4928-89b5-174f5e435627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9a9cb4-4f9e-4788-a1be-e7607f18105c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:33 devstack cinder-volume[87504]: DEBUG cinder.image.glance [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Creating Keystone auth plugin from conf {{(pid=87504) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 04 15:57:33 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:57:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Flow 'volume_create_manager' (f0725c3b-96c2-46e4-a5a8-477666289218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d4b95a7-837a-4a73-918e-48dcccd01546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d4b95a7-837a-4a73-918e-48dcccd01546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-796008382',display_name='tempest-VolumesGetTest-Volume-1454321615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb5fa6f-6df4-4e4b-81f8-c768e081adcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6c277473a44f819a2785f8e459d058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:34Z,use_quota=True,user_id='71aaedd9a29b44df9edb60fbb98be877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:33 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef6ed61f-e481-4a0f-8a28-a937c7725e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef6ed61f-e481-4a0f-8a28-a937c7725e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edfdb3a0-f96d-42a3-9407-f2de24ae352f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edfdb3a0-f96d-42a3-9407-f2de24ae352f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fb5fa6f-6df4-4e4b-81f8-c768e081adcc', 'volume_name': 'volume-1fb5fa6f-6df4-4e4b-81f8-c768e081adcc', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28915681-e15e-4b87-a1f2-8dbb3a943423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28915681-e15e-4b87-a1f2-8dbb3a943423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cb99d8-2ad8-470e-ae48-93956fa4048a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:33 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Volume 1fb5fa6f-6df4-4e4b-81f8-c768e081adcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fb5fa6f-6df4-4e4b-81f8-c768e081adcc', 'volume_size': 1}
Sep 04 15:57:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e" returned: 0 in 0.697s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:33 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-796008382',display_name='tempest-VolumesGetTest-Volume-1454321615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb5fa6f-6df4-4e4b-81f8-c768e081adcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6c277473a44f819a2785f8e459d058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:34Z,use_quota=True,user_id='71aaedd9a29b44df9edb60fbb98be877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Creating volume 1fb5fa6f-6df4-4e4b-81f8-c768e081adcc {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:57:34 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1fb5fa6f-6df4-4e4b-81f8-c768e081adcc 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:34 devstack sudo[98768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1fb5fa6f-6df4-4e4b-81f8-c768e081adcc 1073741824
Sep 04 15:57:34 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d44efc74-fdbb-4b74-a4f4-44a53831a40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e1e5b2b-1bb9-4a15-8b3c-cfcecd9074c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:34 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Volume volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e (2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e): created successfully
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e1e5b2b-1bb9-4a15-8b3c-cfcecd9074c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Flow 'volume_create_manager' (4c27c9b6-edf0-4637-99ab-5a73b58e70f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Flow 'volume_create_manager' (01e5277a-fcf0-4fea-983f-ef2b2fcd5837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ee6394-a883-4701-92fd-7e2ab1bd0718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:34 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-24074837-9d23-4b62-b5b1-51fe22dc769e tempest-GroupsV314Test-320423269 None] Created volume successfully.
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ee6394-a883-4701-92fd-7e2ab1bd0718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-908588620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5fd92cd-f334-47a4-ab3b-d57bd66430e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='48ca2e2ddbed40dabaa8002624c61d85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:34Z,use_quota=True,user_id='26d753943b3042a0b8345ae214666646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21a645cf-2110-480e-80c1-54be1c3ceb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21a645cf-2110-480e-80c1-54be1c3ceb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (791162a3-a3df-4214-9ac9-d64f45f85d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (791162a3-a3df-4214-9ac9-d64f45f85d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5fd92cd-f334-47a4-ab3b-d57bd66430e3', 'volume_name': 'volume-c5fd92cd-f334-47a4-ab3b-d57bd66430e3', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b31aa73-4f3b-4239-9e20-e52e42d82e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b31aa73-4f3b-4239-9e20-e52e42d82e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df2ea094-d595-436f-9c7a-f9364fa0c9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:34 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Volume c5fd92cd-f334-47a4-ab3b-d57bd66430e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5fd92cd-f334-47a4-ab3b-d57bd66430e3', 'volume_size': 1}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9a9cb4-4f9e-4788-a1be-e7607f18105c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f6887e6f-45ff-4bbb-920c-f0cf1c634f61', 'volume_name': 'volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61', 'volume_size': 1, 'image_id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f6dbd3908a2d48468b7f486df9705903', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9488c80e-bb64-48e5-b1fb-9998fd167822/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1ad73f0e0>}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffefcbc5-4e6f-442d-92f1-63b04eec9abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffefcbc5-4e6f-442d-92f1-63b04eec9abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27019e14-c266-45ce-9b85-8bd93dc2784c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:34 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Volume f6887e6f-45ff-4bbb-920c-f0cf1c634f61: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61', 'volume_size': 1, 'image_id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f6dbd3908a2d48468b7f486df9705903', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9488c80e-bb64-48e5-b1fb-9998fd167822/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1ad73f0e0>}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Trying to clone f6887e6f-45ff-4bbb-920c-f0cf1c634f61 from image 9488c80e-bb64-48e5-b1fb-9998fd167822 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}]). {{(pid=87504) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 04 15:57:34 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1fb5fa6f-6df4-4e4b-81f8-c768e081adcc 1073741824" returned: 0 in 0.524s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_sidjpruedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 04 15:57:34 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Image download 20.69 MB at 20.69 MB/s
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c327d67-0ae0-4694-93f6-f2f90861b280]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_sidjpruedevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1fb5fa6f-6df4-4e4b-81f8-c768e081adcc {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:34 devstack sudo[98777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1fb5fa6f-6df4-4e4b-81f8-c768e081adcc
Sep 04 15:57:34 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:34 devstack sudo[98776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_sidjpruedevstack@QuobyteHD
Sep 04 15:57:34 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:34 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1fb5fa6f-6df4-4e4b-81f8-c768e081adcc" returned: 0 in 0.281s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.721s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-908588620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5fd92cd-f334-47a4-ab3b-d57bd66430e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='48ca2e2ddbed40dabaa8002624c61d85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:34Z,use_quota=True,user_id='26d753943b3042a0b8345ae214666646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Creating volume c5fd92cd-f334-47a4-ab3b-d57bd66430e3 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:57:34 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c5fd92cd-f334-47a4-ab3b-d57bd66430e3 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:34 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_sidjpruedevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Temporary image 9488c80e-bb64-48e5-b1fb-9998fd167822 is fetched for user 90d5e85a72624a96955885229bac933b. {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 04 15:57:34 devstack sudo[98786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c5fd92cd-f334-47a4-ab3b-d57bd66430e3 1073741824
Sep 04 15:57:34 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cb99d8-2ad8-470e-ae48-93956fa4048a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fb5fa6f-6df4-4e4b-81f8-c768e081adcc', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df0f94de-07a4-4030-85a9-51c2edbdff0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:35 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Volume volume-1fb5fa6f-6df4-4e4b-81f8-c768e081adcc (1fb5fa6f-6df4-4e4b-81f8-c768e081adcc): created successfully
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df0f94de-07a4-4030-85a9-51c2edbdff0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Flow 'volume_create_manager' (f0725c3b-96c2-46e4-a5a8-477666289218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:35 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-0480c6e7-0ecd-48db-b556-85f5e534ebc1 tempest-VolumesGetTest-886688485 None] Created volume successfully.
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa404f65-5348-41e5-b314-9d99e221cc7c]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_sidjpruedevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:35 devstack sudo[98788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_sidjpruedevstack@QuobyteHD
Sep 04 15:57:35 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:35 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_sidjpruedevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:35 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c5fd92cd-f334-47a4-ab3b-d57bd66430e3 1073741824" returned: 0 in 0.558s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c5fd92cd-f334-47a4-ab3b-d57bd66430e3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:35 devstack sudo[98797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c5fd92cd-f334-47a4-ab3b-d57bd66430e3
Sep 04 15:57:35 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:35 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c5fd92cd-f334-47a4-ab3b-d57bd66430e3" returned: 0 in 0.270s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.316s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-937206113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6887e6f-45ff-4bbb-920c-f0cf1c634f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf4942e362e4e80b9e67cd0f8c8fa7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:33Z,use_quota=True,user_id='90d5e85a72624a96955885229bac933b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Creating volume f6887e6f-45ff-4bbb-920c-f0cf1c634f61 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:57:35 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:35 devstack sudo[98800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61 1073741824
Sep 04 15:57:35 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df2ea094-d595-436f-9c7a-f9364fa0c9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5fd92cd-f334-47a4-ab3b-d57bd66430e3', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d343aab9-cf5c-448a-ab3a-0925bc215aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:35 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Volume volume-c5fd92cd-f334-47a4-ab3b-d57bd66430e3 (c5fd92cd-f334-47a4-ab3b-d57bd66430e3): created successfully
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d343aab9-cf5c-448a-ab3a-0925bc215aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Flow 'volume_create_manager' (01e5277a-fcf0-4fea-983f-ef2b2fcd5837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:35 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-a1eb440d-3506-4f1e-b33e-913f9b5bb4d3 req-75ad994f-ea08-4046-a342-048517222edb tempest-VolumesGetTestJSON-1749876238 None] Created volume successfully.
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-19efbf3d-b909-460b-affc-aced740f3acf tempest-VolumesGetTest-886688485 None] Acquiring lock "cinder-1fb5fa6f-6df4-4e4b-81f8-c768e081adcc-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-19efbf3d-b909-460b-affc-aced740f3acf tempest-VolumesGetTest-886688485 None] Lock "cinder-1fb5fa6f-6df4-4e4b-81f8-c768e081adcc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-19efbf3d-b909-460b-affc-aced740f3acf tempest-VolumesGetTest-886688485 None] Acquiring lock "cinder-quobyte-1fb5fa6f-6df4-4e4b-81f8-c768e081adcc" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-19efbf3d-b909-460b-affc-aced740f3acf tempest-VolumesGetTest-886688485 None] Lock "cinder-quobyte-1fb5fa6f-6df4-4e4b-81f8-c768e081adcc" acquired by "delete_volume" :: waited 0.024s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5240d5a1-ee2b-44fc-943d-b8d4a3f2267f]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-19efbf3d-b909-460b-affc-aced740f3acf tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1fb5fa6f-6df4-4e4b-81f8-c768e081adcc {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:36 devstack sudo[98806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1fb5fa6f-6df4-4e4b-81f8-c768e081adcc
Sep 04 15:57:36 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:36 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61 1073741824" returned: 0 in 0.554s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:36 devstack sudo[98808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61
Sep 04 15:57:36 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-14ffcee3-b3e3-4a12-9b2f-09815955a79d req-1069d47d-d953-4ad2-92f8-8fb2c58e8991 tempest-VolumesGetTestJSON-1749876238 None] Acquiring lock "cinder-c5fd92cd-f334-47a4-ab3b-d57bd66430e3-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-14ffcee3-b3e3-4a12-9b2f-09815955a79d req-1069d47d-d953-4ad2-92f8-8fb2c58e8991 tempest-VolumesGetTestJSON-1749876238 None] Lock "cinder-c5fd92cd-f334-47a4-ab3b-d57bd66430e3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-14ffcee3-b3e3-4a12-9b2f-09815955a79d req-1069d47d-d953-4ad2-92f8-8fb2c58e8991 tempest-VolumesGetTestJSON-1749876238 None] Acquiring lock "cinder-quobyte-c5fd92cd-f334-47a4-ab3b-d57bd66430e3" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-14ffcee3-b3e3-4a12-9b2f-09815955a79d req-1069d47d-d953-4ad2-92f8-8fb2c58e8991 tempest-VolumesGetTestJSON-1749876238 None] Lock "cinder-quobyte-c5fd92cd-f334-47a4-ab3b-d57bd66430e3" acquired by "delete_volume" :: waited 0.017s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd11b4e-71d6-4a25-b88b-1e6a26e64b14]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-14ffcee3-b3e3-4a12-9b2f-09815955a79d req-1069d47d-d953-4ad2-92f8-8fb2c58e8991 tempest-VolumesGetTestJSON-1749876238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c5fd92cd-f334-47a4-ab3b-d57bd66430e3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:36 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-19efbf3d-b909-460b-affc-aced740f3acf tempest-VolumesGetTest-886688485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1fb5fa6f-6df4-4e4b-81f8-c768e081adcc" returned: 0 in 0.432s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-19efbf3d-b909-460b-affc-aced740f3acf tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1fb5fa6f-6df4-4e4b-81f8-c768e081adcc {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:36 devstack sudo[98814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1fb5fa6f-6df4-4e4b-81f8-c768e081adcc
Sep 04 15:57:36 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:36 devstack sudo[98813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c5fd92cd-f334-47a4-ab3b-d57bd66430e3
Sep 04 15:57:36 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:36 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61" returned: 0 in 0.365s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.953s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:36 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Cloning volume 2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e to volume 5657f288-6243-43b8-b178-0a5898c9e1a2
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Attempting download of 9488c80e-bb64-48e5-b1fb-9998fd167822 ((None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}])) to volume f6887e6f-45ff-4bbb-920c-f0cf1c634f61. {{(pid=87504) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Creating offline snapshot 400b5edd-d168-4645-80c0-67ce33d28f93 of volume 2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bafe364-5843-40c5-bed8-8c0121fd8eb6]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9e5f55-027c-4815-bafd-fb9b782298b8]: (4, 'raw') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_zvqdt8lx {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:36 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-19efbf3d-b909-460b-affc-aced740f3acf tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1fb5fa6f-6df4-4e4b-81f8-c768e081adcc" returned: 0 in 0.279s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-19efbf3d-b909-460b-affc-aced740f3acf tempest-VolumesGetTest-886688485 None] Lock "cinder-quobyte-1fb5fa6f-6df4-4e4b-81f8-c768e081adcc" released by "delete_volume" :: held 0.759s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:36 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-19efbf3d-b909-460b-affc-aced740f3acf tempest-VolumesGetTest-886688485 None] Created reservations ['360544be-a10d-4865-9259-36631216b2e8', '4f2d5a8f-92fb-48c4-a1fa-00d16bc219a8', '90f57404-6a8a-4b5f-9c10-238694afd776', '4281e0a1-a3e4-466b-8093-987165783ecb'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:57:37 devstack sudo[98819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e
Sep 04 15:57:37 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:37 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-14ffcee3-b3e3-4a12-9b2f-09815955a79d req-1069d47d-d953-4ad2-92f8-8fb2c58e8991 tempest-VolumesGetTestJSON-1749876238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c5fd92cd-f334-47a4-ab3b-d57bd66430e3" returned: 0 in 0.418s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-14ffcee3-b3e3-4a12-9b2f-09815955a79d req-1069d47d-d953-4ad2-92f8-8fb2c58e8991 tempest-VolumesGetTestJSON-1749876238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c5fd92cd-f334-47a4-ab3b-d57bd66430e3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:37 devstack sudo[98820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_zvqdt8lx
Sep 04 15:57:37 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:37 devstack sudo[98826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c5fd92cd-f334-47a4-ab3b-d57bd66430e3
Sep 04 15:57:37 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-19efbf3d-b909-460b-affc-aced740f3acf tempest-VolumesGetTest-886688485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-19efbf3d-b909-460b-affc-aced740f3acf tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-19efbf3d-b909-460b-affc-aced740f3acf tempest-VolumesGetTest-886688485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-19efbf3d-b909-460b-affc-aced740f3acf tempest-VolumesGetTest-886688485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-19efbf3d-b909-460b-affc-aced740f3acf tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-19efbf3d-b909-460b-affc-aced740f3acf tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:37 devstack sudo[98829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:57:37 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:37 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e" returned: 0 in 0.514s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.400b5edd-d168-4645-80c0-67ce33d28f93 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:37 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-19efbf3d-b909-460b-affc-aced740f3acf tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.322s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-19efbf3d-b909-460b-affc-aced740f3acf tempest-VolumesGetTest-886688485 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e6382b11-56ba-4d69-9bb3-ce7523dbc491 tempest-VolumesGetTest-886688485 None] Acquiring lock "cinder-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:37 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:37 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-19efbf3d-b909-460b-affc-aced740f3acf tempest-VolumesGetTest-886688485 None] Deleted volume successfully.
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-14ffcee3-b3e3-4a12-9b2f-09815955a79d req-1069d47d-d953-4ad2-92f8-8fb2c58e8991 tempest-VolumesGetTestJSON-1749876238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c5fd92cd-f334-47a4-ab3b-d57bd66430e3" returned: 0 in 0.408s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:37 devstack sudo[98838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.400b5edd-d168-4645-80c0-67ce33d28f93 1G
Sep 04 15:57:37 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:37 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-14ffcee3-b3e3-4a12-9b2f-09815955a79d req-1069d47d-d953-4ad2-92f8-8fb2c58e8991 tempest-VolumesGetTestJSON-1749876238 None] Lock "cinder-quobyte-c5fd92cd-f334-47a4-ab3b-d57bd66430e3" released by "delete_volume" :: held 0.904s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e6382b11-56ba-4d69-9bb3-ce7523dbc491 tempest-VolumesGetTest-886688485 None] Lock "cinder-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_zvqdt8lx" returned: 0 in 0.625s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_zvqdt8lx {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-19efbf3d-b909-460b-affc-aced740f3acf tempest-VolumesGetTest-886688485 None] Lock "cinder-1fb5fa6f-6df4-4e4b-81f8-c768e081adcc-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e6382b11-56ba-4d69-9bb3-ce7523dbc491 tempest-VolumesGetTest-886688485 None] Acquiring lock "cinder-quobyte-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e6382b11-56ba-4d69-9bb3-ce7523dbc491 tempest-VolumesGetTest-886688485 None] Lock "cinder-quobyte-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1" acquired by "delete_volume" :: waited 0.040s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG cinder.quota [req-14ffcee3-b3e3-4a12-9b2f-09815955a79d req-1069d47d-d953-4ad2-92f8-8fb2c58e8991 tempest-VolumesGetTestJSON-1749876238 None] Created reservations ['f8c740f6-9045-4446-9ba9-e83589e7c634', '6be43c61-b628-4e55-8f62-2e02a57c4543', '2c38c5b8-71de-476f-babf-1a6c618548e7', '12f76671-c2d6-44c7-86c4-ab2530ff8983'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2daf8ab8-f740-4883-97a4-1b517b34265c]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:37 devstack sudo[98840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_zvqdt8lx
Sep 04 15:57:37 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e6382b11-56ba-4d69-9bb3-ce7523dbc491 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-14ffcee3-b3e3-4a12-9b2f-09815955a79d req-1069d47d-d953-4ad2-92f8-8fb2c58e8991 tempest-VolumesGetTestJSON-1749876238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-14ffcee3-b3e3-4a12-9b2f-09815955a79d req-1069d47d-d953-4ad2-92f8-8fb2c58e8991 tempest-VolumesGetTestJSON-1749876238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [req-14ffcee3-b3e3-4a12-9b2f-09815955a79d req-1069d47d-d953-4ad2-92f8-8fb2c58e8991 tempest-VolumesGetTestJSON-1749876238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [req-14ffcee3-b3e3-4a12-9b2f-09815955a79d req-1069d47d-d953-4ad2-92f8-8fb2c58e8991 tempest-VolumesGetTestJSON-1749876238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-14ffcee3-b3e3-4a12-9b2f-09815955a79d req-1069d47d-d953-4ad2-92f8-8fb2c58e8991 tempest-VolumesGetTestJSON-1749876238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-14ffcee3-b3e3-4a12-9b2f-09815955a79d req-1069d47d-d953-4ad2-92f8-8fb2c58e8991 tempest-VolumesGetTestJSON-1749876238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:37 devstack sudo[98842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1
Sep 04 15:57:37 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:37 devstack sudo[98846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:57:37 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:37 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_zvqdt8lx" returned: 1 in 0.411s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_zvqdt8lx' failed. Not Retrying. {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0e7ace-379b-40d8-896c-62447c097b0a]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_sidjpruedevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:37 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.400b5edd-d168-4645-80c0-67ce33d28f93 1G" returned: 0 in 0.611s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.400b5edd-d168-4645-80c0-67ce33d28f93 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:38 devstack sudo[98852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.400b5edd-d168-4645-80c0-67ce33d28f93
Sep 04 15:57:38 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:38 devstack sudo[98851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_sidjpruedevstack@QuobyteHD
Sep 04 15:57:38 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:38 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-14ffcee3-b3e3-4a12-9b2f-09815955a79d req-1069d47d-d953-4ad2-92f8-8fb2c58e8991 tempest-VolumesGetTestJSON-1749876238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.312s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:38 devstack cinder-volume[87504]: DEBUG cinder.manager [req-14ffcee3-b3e3-4a12-9b2f-09815955a79d req-1069d47d-d953-4ad2-92f8-8fb2c58e8991 tempest-VolumesGetTestJSON-1749876238 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:57:38 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-14ffcee3-b3e3-4a12-9b2f-09815955a79d req-1069d47d-d953-4ad2-92f8-8fb2c58e8991 tempest-VolumesGetTestJSON-1749876238 None] Deleted volume successfully.
Sep 04 15:57:38 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e6382b11-56ba-4d69-9bb3-ce7523dbc491 tempest-VolumesGetTest-886688485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1" returned: 0 in 0.450s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e6382b11-56ba-4d69-9bb3-ce7523dbc491 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:38 devstack sudo[98860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1
Sep 04 15:57:38 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:38 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-14ffcee3-b3e3-4a12-9b2f-09815955a79d req-1069d47d-d953-4ad2-92f8-8fb2c58e8991 tempest-VolumesGetTestJSON-1749876238 None] Lock "cinder-c5fd92cd-f334-47a4-ab3b-d57bd66430e3-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:38 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_sidjpruedevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:38 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] 9488c80e-bb64-48e5-b1fb-9998fd167822 was qcow2, converting to qcow2 {{(pid=87504) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 04 15:57:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_sidjpruedevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:38 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.400b5edd-d168-4645-80c0-67ce33d28f93" returned: 0 in 0.350s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:38 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.400b5edd-d168-4645-80c0-67ce33d28f93 is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 15:57:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.400b5edd-d168-4645-80c0-67ce33d28f93 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:38 devstack sudo[98869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_sidjpruedevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61
Sep 04 15:57:38 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:38 devstack sudo[98870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.400b5edd-d168-4645-80c0-67ce33d28f93
Sep 04 15:57:38 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:38 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e6382b11-56ba-4d69-9bb3-ce7523dbc491 tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1" returned: 0 in 0.306s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:38 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e6382b11-56ba-4d69-9bb3-ce7523dbc491 tempest-VolumesGetTest-886688485 None] Lock "cinder-quobyte-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1" released by "delete_volume" :: held 0.819s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:38 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-e6382b11-56ba-4d69-9bb3-ce7523dbc491 tempest-VolumesGetTest-886688485 None] Created reservations ['04f14508-e5b1-4d09-ba11-b0cbff0fb416', 'd3c0f2d4-c4bd-468d-a515-df72c85842fd', '6774c9e9-2a0f-491f-898c-11418be53735', '0bae3ab4-b45d-4fcf-9d2e-4fa50c47eca8'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:57:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e6382b11-56ba-4d69-9bb3-ce7523dbc491 tempest-VolumesGetTest-886688485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e6382b11-56ba-4d69-9bb3-ce7523dbc491 tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e6382b11-56ba-4d69-9bb3-ce7523dbc491 tempest-VolumesGetTest-886688485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e6382b11-56ba-4d69-9bb3-ce7523dbc491 tempest-VolumesGetTest-886688485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e6382b11-56ba-4d69-9bb3-ce7523dbc491 tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e6382b11-56ba-4d69-9bb3-ce7523dbc491 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:38 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.400b5edd-d168-4645-80c0-67ce33d28f93" returned: 0 in 0.348s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:38 devstack sudo[98878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:57:38 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:38 devstack sudo[98880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.info
Sep 04 15:57:38 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:38 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e6382b11-56ba-4d69-9bb3-ce7523dbc491 tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.294s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:38 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-e6382b11-56ba-4d69-9bb3-ce7523dbc491 tempest-VolumesGetTest-886688485 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:57:38 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e6382b11-56ba-4d69-9bb3-ce7523dbc491 tempest-VolumesGetTest-886688485 None] Deleted volume successfully.
Sep 04 15:57:39 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e6382b11-56ba-4d69-9bb3-ce7523dbc491 tempest-VolumesGetTest-886688485 None] Lock "cinder-bd46e3c0-99c3-408c-8308-f7a62a0c9ec1-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:39 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.info" returned: 0 in 0.297s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:39 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 15:57:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:39 devstack sudo[98891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.info
Sep 04 15:57:39 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:39 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.info" returned: 0 in 0.276s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:39 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Acquiring lock "cinder-quobyte-5657f288-6243-43b8-b178-0a5898c9e1a2" by "_copy_volume_from_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:39 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Lock "cinder-quobyte-5657f288-6243-43b8-b178-0a5898c9e1a2" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:39 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] snapshot: 400b5edd-d168-4645-80c0-67ce33d28f93, volume: 5657f288-6243-43b8-b178-0a5898c9e1a2,  {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 04 15:57:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:39 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:39 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:39 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e230a6b9-131b-4f5c-a1ce-e5ac4d22158d]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.400b5edd-d168-4645-80c0-67ce33d28f93 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:39 devstack sudo[98894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.400b5edd-d168-4645-80c0-67ce33d28f93
Sep 04 15:57:39 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:39 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a5f08250-c1f4-4177-b4cc-b379cf6e4d9e tempest-VolumesGetTest-886688485 None] Acquiring lock "cinder-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:39 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a5f08250-c1f4-4177-b4cc-b379cf6e4d9e tempest-VolumesGetTest-886688485 None] Lock "cinder-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:39 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a5f08250-c1f4-4177-b4cc-b379cf6e4d9e tempest-VolumesGetTest-886688485 None] Acquiring lock "cinder-quobyte-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:39 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a5f08250-c1f4-4177-b4cc-b379cf6e4d9e tempest-VolumesGetTest-886688485 None] Lock "cinder-quobyte-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43" acquired by "delete_volume" :: waited 0.032s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:39 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.400b5edd-d168-4645-80c0-67ce33d28f93" returned: 0 in 0.517s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:39 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:57:39 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c5cf58-b30e-4ccb-97cf-74d96c51f4ae]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a5f08250-c1f4-4177-b4cc-b379cf6e4d9e tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:40 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0353b4bc-ef6a-49d0-9dc5-5bed6b09577b]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:40 devstack sudo[98900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43
Sep 04 15:57:40 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:40 devstack sudo[98901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e
Sep 04 15:57:40 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:40 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a5f08250-c1f4-4177-b4cc-b379cf6e4d9e tempest-VolumesGetTest-886688485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43" returned: 0 in 0.452s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a5f08250-c1f4-4177-b4cc-b379cf6e4d9e tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:40 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e" returned: 0 in 0.469s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:40 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 04 15:57:40 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Creating direct copy from snapshot {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 04 15:57:40 devstack sudo[98910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43
Sep 04 15:57:40 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:40 devstack cinder-volume[87504]: DEBUG cinder.utils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Path /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5657f288-6243-43b8-b178-0a5898c9e1a2 not found in is_blk_device check {{(pid=87504) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 04 15:57:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5657f288-6243-43b8-b178-0a5898c9e1a2 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:40 devstack sudo[98912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5657f288-6243-43b8-b178-0a5898c9e1a2
Sep 04 15:57:40 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:40 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_sidjpruedevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61" returned: 0 in 2.306s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:40 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_sidjpruedevstack@QuobyteHD, size 112.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61 {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 15:57:40 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Converted 112.00 MB image at 48.55 MB/s
Sep 04 15:57:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:40 devstack sudo[98914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61 1G
Sep 04 15:57:40 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:40 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a5f08250-c1f4-4177-b4cc-b379cf6e4d9e tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43" returned: 0 in 0.297s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:40 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a5f08250-c1f4-4177-b4cc-b379cf6e4d9e tempest-VolumesGetTest-886688485 None] Lock "cinder-quobyte-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43" released by "delete_volume" :: held 0.840s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:40 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-a5f08250-c1f4-4177-b4cc-b379cf6e4d9e tempest-VolumesGetTest-886688485 None] Created reservations ['8b1e6ca6-fc18-4996-b426-0b9e4e9187d7', '6598a684-0246-4d9d-b5a2-e91fd3849055', 'fc808e60-bb21-46d2-9a47-da8dd5ef1340', '160df135-94e2-4255-97d9-0d23e324413e'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:57:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a5f08250-c1f4-4177-b4cc-b379cf6e4d9e tempest-VolumesGetTest-886688485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a5f08250-c1f4-4177-b4cc-b379cf6e4d9e tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:40 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a5f08250-c1f4-4177-b4cc-b379cf6e4d9e tempest-VolumesGetTest-886688485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:40 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a5f08250-c1f4-4177-b4cc-b379cf6e4d9e tempest-VolumesGetTest-886688485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a5f08250-c1f4-4177-b4cc-b379cf6e4d9e tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a5f08250-c1f4-4177-b4cc-b379cf6e4d9e tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:41 devstack sudo[98924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:57:41 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:41 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61 1G" returned: 0 in 0.437s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:41 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Downloaded image 9488c80e-bb64-48e5-b1fb-9998fd167822 ((None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}])) to volume f6887e6f-45ff-4bbb-920c-f0cf1c634f61 successfully. {{(pid=87504) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 04 15:57:41 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Temporary image 9488c80e-bb64-48e5-b1fb-9998fd167822 for user 90d5e85a72624a96955885229bac933b is deleted. {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 04 15:57:41 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Marking volume f6887e6f-45ff-4bbb-920c-f0cf1c634f61 as bootable. {{(pid=87504) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 04 15:57:41 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Copying metadata from image 9488c80e-bb64-48e5-b1fb-9998fd167822 to f6887e6f-45ff-4bbb-920c-f0cf1c634f61. {{(pid=87504) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 04 15:57:41 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Creating volume glance metadata for volume f6887e6f-45ff-4bbb-920c-f0cf1c634f61 backed by image 9488c80e-bb64-48e5-b1fb-9998fd167822 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87504) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 04 15:57:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27019e14-c266-45ce-9b85-8bd93dc2784c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61', 'volume_size': 1, 'image_id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f6dbd3908a2d48468b7f486df9705903', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9488c80e-bb64-48e5-b1fb-9998fd167822/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1ad73f0e0>}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd92e79-24be-4343-b190-5d76143c7159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:41 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Volume volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61 (f6887e6f-45ff-4bbb-920c-f0cf1c634f61): created successfully
Sep 04 15:57:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd92e79-24be-4343-b190-5d76143c7159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Flow 'volume_create_manager' (e1c2990c-6be8-4443-9dbb-4dd68734b775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:41 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a5f08250-c1f4-4177-b4cc-b379cf6e4d9e tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.504s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:41 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-a5f08250-c1f4-4177-b4cc-b379cf6e4d9e tempest-VolumesGetTest-886688485 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:57:41 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-cd0753f4-3a32-4da7-84a7-cd6d496eea4b tempest-VolumesExtendTest-546575527 None] Created volume successfully.
Sep 04 15:57:41 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-a5f08250-c1f4-4177-b4cc-b379cf6e4d9e tempest-VolumesGetTest-886688485 None] Deleted volume successfully.
Sep 04 15:57:41 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a5f08250-c1f4-4177-b4cc-b379cf6e4d9e tempest-VolumesGetTest-886688485 None] Lock "cinder-0533d20d-e7c7-4b2a-a1b0-7a86729b3a43-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b81ba287-7640-4d71-88cd-0ec739e16f71 tempest-VolumesExtendTest-546575527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:43 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:57:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Flow 'volume_create_manager' (7c0d3431-eb0e-4797-b037-6a49bf3853d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb2ad12-d9e7-426d-a2f8-24ad2620f37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb2ad12-d9e7-426d-a2f8-24ad2620f37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1151715213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc89a29-5f53-452c-839a-5be0d99b3703,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4b6c277473a44f819a2785f8e459d058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:43Z,use_quota=True,user_id='71aaedd9a29b44df9edb60fbb98be877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8172093a-682a-49f7-a436-c6d7c3d539b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8172093a-682a-49f7-a436-c6d7c3d539b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d7545e-944b-408f-b3c7-75d28d2bb5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:43 devstack cinder-volume[87504]: DEBUG cinder.image.glance [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Creating Keystone auth plugin from conf {{(pid=87504) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 04 15:57:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d7545e-944b-408f-b3c7-75d28d2bb5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8bc89a29-5f53-452c-839a-5be0d99b3703', 'volume_name': 'volume-8bc89a29-5f53-452c-839a-5be0d99b3703', 'volume_size': 1, 'image_id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f6dbd3908a2d48468b7f486df9705903', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9488c80e-bb64-48e5-b1fb-9998fd167822/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1a2c9ddc0>}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e26bbf7e-2f5d-428a-8257-2702616899ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e26bbf7e-2f5d-428a-8257-2702616899ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (623adb19-689a-4a24-bcf5-702c8c18835f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:44 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Volume 8bc89a29-5f53-452c-839a-5be0d99b3703: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8bc89a29-5f53-452c-839a-5be0d99b3703', 'volume_size': 1, 'image_id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f6dbd3908a2d48468b7f486df9705903', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9488c80e-bb64-48e5-b1fb-9998fd167822/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1a2c9ddc0>}
Sep 04 15:57:44 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Trying to clone 8bc89a29-5f53-452c-839a-5be0d99b3703 from image 9488c80e-bb64-48e5-b1fb-9998fd167822 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}]). {{(pid=87504) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 04 15:57:45 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_f_ref1tcdevstack@QuobyteHD, size 20.69 MB, duration 1.19 sec {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 04 15:57:45 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Image download 20.69 MB at 17.40 MB/s
Sep 04 15:57:45 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[23855592-09cc-4ade-911c-3e15fa76323b]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_f_ref1tcdevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:46 devstack sudo[98937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_f_ref1tcdevstack@QuobyteHD
Sep 04 15:57:46 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-31e6475d-6287-4abb-a1e9-c80239f6be03 tempest-BackendsCapabilitiesAdminTestsJSON-713204266 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7594451904297, 'free_capacity_gb': 1773.7594451904297, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87504) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 04 15:57:46 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5657f288-6243-43b8-b178-0a5898c9e1a2" returned: 0 in 6.165s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:46 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e, size 1024.00 MB, duration 6.17 sec, destination /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5657f288-6243-43b8-b178-0a5898c9e1a2 {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 15:57:46 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Converted 1024.00 MB image at 166.07 MB/s
Sep 04 15:57:46 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5657f288-6243-43b8-b178-0a5898c9e1a2 is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 15:57:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5657f288-6243-43b8-b178-0a5898c9e1a2 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:46 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_f_ref1tcdevstack@QuobyteHD" returned: 0 in 0.917s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:46 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Temporary image 9488c80e-bb64-48e5-b1fb-9998fd167822 is fetched for user 71aaedd9a29b44df9edb60fbb98be877. {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 04 15:57:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-286478a2-442a-4f66-b97e-b0e4db0210c1 tempest-BackendsCapabilitiesAdminTestsJSON-713204266 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7594451904297, 'free_capacity_gb': 1773.7594451904297, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87504) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 04 15:57:46 devstack sudo[98942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5657f288-6243-43b8-b178-0a5898c9e1a2
Sep 04 15:57:46 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:46 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=159,cinder:INSERT=51,cinder:UPDATE=205,cinder:DELETE=16 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:57:46 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:INSERT=55,cinder:UPDATE=200,cinder:SELECT=156,cinder:DELETE=19 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:57:46 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e45b0d-25ed-4c18-a206-e4a15ba73897]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_f_ref1tcdevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:46 devstack sudo[98944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_f_ref1tcdevstack@QuobyteHD
Sep 04 15:57:46 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:46 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5657f288-6243-43b8-b178-0a5898c9e1a2" returned: 0 in 0.270s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:46 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Lock "cinder-quobyte-5657f288-6243-43b8-b178-0a5898c9e1a2" released by "_copy_volume_from_snapshot" :: held 7.539s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:46 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Acquiring lock "cinder-quobyte-400b5edd-d168-4645-80c0-67ce33d28f93" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:46 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Lock "cinder-quobyte-400b5edd-d168-4645-80c0-67ce33d28f93" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:46 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Deleting offline snapshot 400b5edd-d168-4645-80c0-67ce33d28f93 of volume 2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 15:57:46 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] snapshot_file for this snap is: volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.400b5edd-d168-4645-80c0-67ce33d28f93 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 15:57:47 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12d51e7-dc4e-4f72-8f5d-a50ae4b1d0a6]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.400b5edd-d168-4645-80c0-67ce33d28f93 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:47 devstack sudo[98947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.400b5edd-d168-4645-80c0-67ce33d28f93
Sep 04 15:57:47 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:47 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_f_ref1tcdevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:47 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.400b5edd-d168-4645-80c0-67ce33d28f93" returned: 0 in 0.412s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:47 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:57:47 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cf3a4e-e5fa-4294-b0f3-00778bd61cb8]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:47 devstack sudo[98957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e
Sep 04 15:57:47 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:48 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e" returned: 0 in 0.561s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.400b5edd-d168-4645-80c0-67ce33d28f93 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:48 devstack sudo[98962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.400b5edd-d168-4645-80c0-67ce33d28f93
Sep 04 15:57:48 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:48 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.400b5edd-d168-4645-80c0-67ce33d28f93" returned: 0 in 0.446s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.400b5edd-d168-4645-80c0-67ce33d28f93 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:48 devstack sudo[98969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.400b5edd-d168-4645-80c0-67ce33d28f93
Sep 04 15:57:48 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:48 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e.400b5edd-d168-4645-80c0-67ce33d28f93" returned: 0 in 0.278s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:48 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Lock "cinder-quobyte-400b5edd-d168-4645-80c0-67ce33d28f93" released by "_delete_snapshot" :: held 1.802s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b81ba287-7640-4d71-88cd-0ec739e16f71 tempest-VolumesExtendTest-546575527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 6.340s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:48 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:57:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:48 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eef7626-fe6d-4e7c-946d-143a3cede952]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b81ba287-7640-4d71-88cd-0ec739e16f71 tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:48 devstack sudo[98972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:57:48 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:48 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-ce4ec1d1-aae2-416d-80ea-953ad2baf36c tempest-GroupsV314Test-320423269 None] Create group from source-group-1d428326-b2ac-4eef-9bc3-d21f53d8d136 completed successfully.
Sep 04 15:57:48 devstack sudo[98973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61
Sep 04 15:57:48 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:49 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.315s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:49 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:57:49 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager._thread_info {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:57:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread count: 28 {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 15:57:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread info: [<_MainThread(MainThread, started 131673838448768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131673724603200)>, <Thread(Thread-3 (stat_writer), started daemon 131673723495936)>, <Thread(Rabbit-heartbeat, started daemon 131673723764800)>, <Thread(Thread-5 (_runner), started daemon 131673722269632)>, <Thread(Thread-7 (_runner), started daemon 131673722322112)>, <Thread(fd_logger, started daemon 131673722585024)>, <Thread(privsep_reader, started daemon 131673721593984)>, <Thread(tpool_thread_0, started daemon 131673714706112)>, <Thread(tpool_thread_1, started daemon 131673706313408)>, <Thread(tpool_thread_2, started daemon 131673697920704)>, <Thread(tpool_thread_3, started daemon 131673689528000)>, <Thread(tpool_thread_4, started daemon 131673681135296)>, <Thread(tpool_thread_5, started daemon 131673672726208)>, <Thread(tpool_thread_6, started daemon 131673664317120)>, <Thread(tpool_thread_7, started daemon 131673655908032)>, <Thread(tpool_thread_8, started daemon 131673647498944)>, <Thread(tpool_thread_9, started daemon 131673639089856)>, <Thread(tpool_thread_10, started daemon 131673630680768)>, <Thread(tpool_thread_11, started daemon 131673622271680)>, <Thread(tpool_thread_12, started daemon 131673613862592)>, <Thread(tpool_thread_13, started daemon 131673605453504)>, <Thread(tpool_thread_14, started daemon 131673597044416)>, <Thread(tpool_thread_15, started daemon 131673588635328)>, <Thread(tpool_thread_16, started daemon 131673580226240)>, <Thread(tpool_thread_17, started daemon 131673571817152)>, <Thread(tpool_thread_18, started daemon 131673563408064)>, <Thread(tpool_thread_19, started daemon 131673554998976)>] {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 15:57:49 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b81ba287-7640-4d71-88cd-0ec739e16f71 tempest-VolumesExtendTest-546575527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61" returned: 0 in 0.455s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b81ba287-7640-4d71-88cd-0ec739e16f71 tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61 2G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b81ba287-7640-4d71-88cd-0ec739e16f71 tempest-VolumesExtendTest-546575527 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61 2G" returned: 0 in 0.158s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b81ba287-7640-4d71-88cd-0ec739e16f71 tempest-VolumesExtendTest-546575527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.664s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.326s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1151715213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc89a29-5f53-452c-839a-5be0d99b3703,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4b6c277473a44f819a2785f8e459d058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:43Z,use_quota=True,user_id='71aaedd9a29b44df9edb60fbb98be877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:57:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Creating volume 8bc89a29-5f53-452c-839a-5be0d99b3703 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:57:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:57:49 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:57:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8bc89a29-5f53-452c-839a-5be0d99b3703 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:49 devstack sudo[98984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8bc89a29-5f53-452c-839a-5be0d99b3703 1073741824
Sep 04 15:57:49 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:49 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-b81ba287-7640-4d71-88cd-0ec739e16f71 tempest-VolumesExtendTest-546575527 None] Extend volume completed successfully.
Sep 04 15:57:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-81920b0d-2768-45ff-a32e-4f7c63a8bd9d tempest-GroupsV314Test-320423269 None] Acquiring lock "cinder-quobyte-5657f288-6243-43b8-b178-0a5898c9e1a2" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-81920b0d-2768-45ff-a32e-4f7c63a8bd9d tempest-GroupsV314Test-320423269 None] Lock "cinder-quobyte-5657f288-6243-43b8-b178-0a5898c9e1a2" acquired by "delete_volume" :: waited 0.022s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:49 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3d6e3d-ca2e-457d-b326-4316a053ac86]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81920b0d-2768-45ff-a32e-4f7c63a8bd9d tempest-GroupsV314Test-320423269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5657f288-6243-43b8-b178-0a5898c9e1a2 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:49 devstack sudo[98989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5657f288-6243-43b8-b178-0a5898c9e1a2
Sep 04 15:57:49 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:50 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8bc89a29-5f53-452c-839a-5be0d99b3703 1073741824" returned: 0 in 0.589s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8bc89a29-5f53-452c-839a-5be0d99b3703 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:50 devstack sudo[98993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8bc89a29-5f53-452c-839a-5be0d99b3703
Sep 04 15:57:50 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:50 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81920b0d-2768-45ff-a32e-4f7c63a8bd9d tempest-GroupsV314Test-320423269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5657f288-6243-43b8-b178-0a5898c9e1a2" returned: 0 in 0.439s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81920b0d-2768-45ff-a32e-4f7c63a8bd9d tempest-GroupsV314Test-320423269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5657f288-6243-43b8-b178-0a5898c9e1a2 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:50 devstack sudo[98998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5657f288-6243-43b8-b178-0a5898c9e1a2
Sep 04 15:57:50 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:50 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8bc89a29-5f53-452c-839a-5be0d99b3703" returned: 0 in 0.320s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:57:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:50 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Attempting download of 9488c80e-bb64-48e5-b1fb-9998fd167822 ((None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}])) to volume 8bc89a29-5f53-452c-839a-5be0d99b3703. {{(pid=87504) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 04 15:57:50 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[271671b2-5487-4e8e-9241-6d1ac978dde6]: (4, 'raw') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_cy_s26l2 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:50 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81920b0d-2768-45ff-a32e-4f7c63a8bd9d tempest-GroupsV314Test-320423269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5657f288-6243-43b8-b178-0a5898c9e1a2" returned: 0 in 0.346s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-81920b0d-2768-45ff-a32e-4f7c63a8bd9d tempest-GroupsV314Test-320423269 None] Lock "cinder-quobyte-5657f288-6243-43b8-b178-0a5898c9e1a2" released by "delete_volume" :: held 0.843s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9dcbbbab-25a3-4657-87f2-27822d1859d0 tempest-VolumesExtendTest-546575527 None] Acquiring lock "cinder-f6887e6f-45ff-4bbb-920c-f0cf1c634f61-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:50 devstack sudo[99002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_cy_s26l2
Sep 04 15:57:50 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9dcbbbab-25a3-4657-87f2-27822d1859d0 tempest-VolumesExtendTest-546575527 None] Lock "cinder-f6887e6f-45ff-4bbb-920c-f0cf1c634f61-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:50 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-81920b0d-2768-45ff-a32e-4f7c63a8bd9d tempest-GroupsV314Test-320423269 None] Created reservations ['89fc56a6-4970-4067-868b-18563433f0bc'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:57:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9dcbbbab-25a3-4657-87f2-27822d1859d0 tempest-VolumesExtendTest-546575527 None] Acquiring lock "cinder-quobyte-f6887e6f-45ff-4bbb-920c-f0cf1c634f61" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9dcbbbab-25a3-4657-87f2-27822d1859d0 tempest-VolumesExtendTest-546575527 None] Lock "cinder-quobyte-f6887e6f-45ff-4bbb-920c-f0cf1c634f61" acquired by "delete_volume" :: waited 0.026s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:50 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c86744c-054a-460b-be5d-6fcd15884038]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9dcbbbab-25a3-4657-87f2-27822d1859d0 tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:50 devstack cinder-volume[87504]: WARNING cinder.quota [None req-81920b0d-2768-45ff-a32e-4f7c63a8bd9d tempest-GroupsV314Test-320423269 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1429397999 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1429397999, it is now deprecated. Please use the default quota class for default quota.
Sep 04 15:57:50 devstack cinder-volume[87504]: WARNING cinder.quota [None req-81920b0d-2768-45ff-a32e-4f7c63a8bd9d tempest-GroupsV314Test-320423269 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1429397999 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1429397999, it is now deprecated. Please use the default quota class for default quota.
Sep 04 15:57:50 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-81920b0d-2768-45ff-a32e-4f7c63a8bd9d tempest-GroupsV314Test-320423269 None] Created reservations ['922f9014-1a86-457a-b86d-890971274c12', '9cac7433-45cc-4704-bb8c-854f2f9f3e5c', 'fe5c0b68-2ec5-4459-b77c-930b23ac3cba', '83e0c7be-7550-4e5c-9dd7-e4af486e58ef'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:57:51 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_cy_s26l2" returned: 0 in 0.485s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_cy_s26l2 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:51 devstack sudo[99004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61
Sep 04 15:57:51 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-81920b0d-2768-45ff-a32e-4f7c63a8bd9d tempest-GroupsV314Test-320423269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-81920b0d-2768-45ff-a32e-4f7c63a8bd9d tempest-GroupsV314Test-320423269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-81920b0d-2768-45ff-a32e-4f7c63a8bd9d tempest-GroupsV314Test-320423269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-81920b0d-2768-45ff-a32e-4f7c63a8bd9d tempest-GroupsV314Test-320423269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-81920b0d-2768-45ff-a32e-4f7c63a8bd9d tempest-GroupsV314Test-320423269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81920b0d-2768-45ff-a32e-4f7c63a8bd9d tempest-GroupsV314Test-320423269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:51 devstack sudo[99007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_cy_s26l2
Sep 04 15:57:51 devstack sudo[99009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:57:51 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:51 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:51 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_cy_s26l2" returned: 1 in 0.378s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_cy_s26l2' failed. Not Retrying. {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a709e80-5500-498e-a565-e3f8e5fa73fd]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_f_ref1tcdevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:51 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9dcbbbab-25a3-4657-87f2-27822d1859d0 tempest-VolumesExtendTest-546575527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61" returned: 0 in 0.583s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9dcbbbab-25a3-4657-87f2-27822d1859d0 tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:51 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81920b0d-2768-45ff-a32e-4f7c63a8bd9d tempest-GroupsV314Test-320423269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.344s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-81920b0d-2768-45ff-a32e-4f7c63a8bd9d tempest-GroupsV314Test-320423269 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:57:51 devstack sudo[99019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61
Sep 04 15:57:51 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:51 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-81920b0d-2768-45ff-a32e-4f7c63a8bd9d tempest-GroupsV314Test-320423269 None] Delete group completed successfully.
Sep 04 15:57:51 devstack sudo[99018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_f_ref1tcdevstack@QuobyteHD
Sep 04 15:57:51 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:51 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9dcbbbab-25a3-4657-87f2-27822d1859d0 tempest-VolumesExtendTest-546575527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f6887e6f-45ff-4bbb-920c-f0cf1c634f61" returned: 0 in 0.320s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9dcbbbab-25a3-4657-87f2-27822d1859d0 tempest-VolumesExtendTest-546575527 None] Lock "cinder-quobyte-f6887e6f-45ff-4bbb-920c-f0cf1c634f61" released by "delete_volume" :: held 0.946s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:51 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_f_ref1tcdevstack@QuobyteHD" returned: 0 in 0.429s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] 9488c80e-bb64-48e5-b1fb-9998fd167822 was qcow2, converting to qcow2 {{(pid=87504) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_f_ref1tcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8bc89a29-5f53-452c-839a-5be0d99b3703 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-9dcbbbab-25a3-4657-87f2-27822d1859d0 tempest-VolumesExtendTest-546575527 None] Created reservations ['3b99c55e-e01c-4267-bce8-e59022d8a408', '238a1cb6-8020-423b-9093-3887c817e19b', '2bdcda03-9519-4877-9779-0d0785c4293e', '61cd7356-e0fa-47c5-8056-d62f6b343f54'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:57:51 devstack sudo[99026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_f_ref1tcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8bc89a29-5f53-452c-839a-5be0d99b3703
Sep 04 15:57:51 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9dcbbbab-25a3-4657-87f2-27822d1859d0 tempest-VolumesExtendTest-546575527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9dcbbbab-25a3-4657-87f2-27822d1859d0 tempest-VolumesExtendTest-546575527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9dcbbbab-25a3-4657-87f2-27822d1859d0 tempest-VolumesExtendTest-546575527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9dcbbbab-25a3-4657-87f2-27822d1859d0 tempest-VolumesExtendTest-546575527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9dcbbbab-25a3-4657-87f2-27822d1859d0 tempest-VolumesExtendTest-546575527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9dcbbbab-25a3-4657-87f2-27822d1859d0 tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:52 devstack sudo[99028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:57:52 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:52 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9dcbbbab-25a3-4657-87f2-27822d1859d0 tempest-VolumesExtendTest-546575527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.317s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:52 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-9dcbbbab-25a3-4657-87f2-27822d1859d0 tempest-VolumesExtendTest-546575527 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:57:52 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-9dcbbbab-25a3-4657-87f2-27822d1859d0 tempest-VolumesExtendTest-546575527 None] Deleted volume successfully.
Sep 04 15:57:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9dcbbbab-25a3-4657-87f2-27822d1859d0 tempest-VolumesExtendTest-546575527 None] Lock "cinder-f6887e6f-45ff-4bbb-920c-f0cf1c634f61-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-29c26733-b941-4451-a452-7c18420460a3 tempest-GroupsV314Test-320423269 None] Acquiring lock "cinder-quobyte-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-29c26733-b941-4451-a452-7c18420460a3 tempest-GroupsV314Test-320423269 None] Lock "cinder-quobyte-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e" acquired by "delete_volume" :: waited 0.033s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:52 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d8e787-9e3f-47db-a032-f0c83205d4d4]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-29c26733-b941-4451-a452-7c18420460a3 tempest-GroupsV314Test-320423269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:52 devstack sudo[99037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e
Sep 04 15:57:52 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:53 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-29c26733-b941-4451-a452-7c18420460a3 tempest-GroupsV314Test-320423269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e" returned: 0 in 0.492s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-29c26733-b941-4451-a452-7c18420460a3 tempest-GroupsV314Test-320423269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:53 devstack sudo[99043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e
Sep 04 15:57:53 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Flow 'volume_create_manager' (c6636ffd-40e3-4ad3-b805-b0195a0d81cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dee8f02-d363-41f0-bc80-c863a3d56d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dee8f02-d363-41f0-bc80-c863a3d56d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1558829626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360f7a76-715f-4a5b-bd4e-1fd96c755f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d04baa8e5a48f0987a104a2afebcd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:53Z,use_quota=True,user_id='ad5cdcbcad74440ab3923357cbe503b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138fb626-70da-4896-ae72-ff30e6a06450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138fb626-70da-4896-ae72-ff30e6a06450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42bce01c-f8cb-42d1-a4a9-afe3f1963d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42bce01c-f8cb-42d1-a4a9-afe3f1963d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '360f7a76-715f-4a5b-bd4e-1fd96c755f8f', 'volume_name': 'volume-360f7a76-715f-4a5b-bd4e-1fd96c755f8f', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b8a046-1332-4e34-a6f4-e4d16b129dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b8a046-1332-4e34-a6f4-e4d16b129dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d5acc0-3275-4380-bb09-04422ac6646f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:53 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Volume 360f7a76-715f-4a5b-bd4e-1fd96c755f8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-360f7a76-715f-4a5b-bd4e-1fd96c755f8f', 'volume_size': 1}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1558829626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360f7a76-715f-4a5b-bd4e-1fd96c755f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d04baa8e5a48f0987a104a2afebcd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:53Z,use_quota=True,user_id='ad5cdcbcad74440ab3923357cbe503b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Creating volume 360f7a76-715f-4a5b-bd4e-1fd96c755f8f {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:57:53 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-360f7a76-715f-4a5b-bd4e-1fd96c755f8f 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:53 devstack sudo[99045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-360f7a76-715f-4a5b-bd4e-1fd96c755f8f 1073741824
Sep 04 15:57:53 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:53 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-29c26733-b941-4451-a452-7c18420460a3 tempest-GroupsV314Test-320423269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e" returned: 0 in 0.328s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-29c26733-b941-4451-a452-7c18420460a3 tempest-GroupsV314Test-320423269 None] Lock "cinder-quobyte-2a1bc599-2e1b-4fb5-91c6-2085ceda1e3e" released by "delete_volume" :: held 0.927s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-29c26733-b941-4451-a452-7c18420460a3 tempest-GroupsV314Test-320423269 None] Created reservations ['e3bc749a-27f3-461e-8893-f40c4e0b9169'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-29c26733-b941-4451-a452-7c18420460a3 tempest-GroupsV314Test-320423269 None] Created reservations ['6576c599-dc62-4f3b-8163-819f022dcdc1', '2e5acfec-721d-4b4a-98cd-c1551b01e4dc', 'e3c67067-d3d8-4b3b-a3a6-23fb50ff45de', '52225ed8-598a-4e8a-9e33-616a3af0b1aa'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-29c26733-b941-4451-a452-7c18420460a3 tempest-GroupsV314Test-320423269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-29c26733-b941-4451-a452-7c18420460a3 tempest-GroupsV314Test-320423269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-29c26733-b941-4451-a452-7c18420460a3 tempest-GroupsV314Test-320423269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-29c26733-b941-4451-a452-7c18420460a3 tempest-GroupsV314Test-320423269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-29c26733-b941-4451-a452-7c18420460a3 tempest-GroupsV314Test-320423269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-29c26733-b941-4451-a452-7c18420460a3 tempest-GroupsV314Test-320423269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:57:53 devstack sudo[99053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:57:53 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Flow 'volume_create_manager' (9f36dd73-8ecc-40e3-af02-93d3125cd946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce77494-b3e2-46a2-92bc-47aa6544418c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce77494-b3e2-46a2-92bc-47aa6544418c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1720210685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ec817d-5e2d-4953-8e91-150c75f0ae23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf4942e362e4e80b9e67cd0f8c8fa7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:54Z,use_quota=True,user_id='90d5e85a72624a96955885229bac933b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e56e5a-b52b-4262-aa00-f9b6e6fb583c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e56e5a-b52b-4262-aa00-f9b6e6fb583c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f2c8397-8a76-4b66-a515-00497488272e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f2c8397-8a76-4b66-a515-00497488272e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8ec817d-5e2d-4953-8e91-150c75f0ae23', 'volume_name': 'volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef55a63-16bb-4f00-ae4d-098a9bb9835a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef55a63-16bb-4f00-ae4d-098a9bb9835a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351f040b-088a-43dc-a8c0-f5d5b99fbebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:53 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Volume c8ec817d-5e2d-4953-8e91-150c75f0ae23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23', 'volume_size': 1}
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:53 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-360f7a76-715f-4a5b-bd4e-1fd96c755f8f 1073741824" returned: 0 in 0.657s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-360f7a76-715f-4a5b-bd4e-1fd96c755f8f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:54 devstack sudo[99055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-360f7a76-715f-4a5b-bd4e-1fd96c755f8f
Sep 04 15:57:54 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:54 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-29c26733-b941-4451-a452-7c18420460a3 tempest-GroupsV314Test-320423269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.319s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-29c26733-b941-4451-a452-7c18420460a3 tempest-GroupsV314Test-320423269 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:57:54 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-29c26733-b941-4451-a452-7c18420460a3 tempest-GroupsV314Test-320423269 None] Delete group completed successfully.
Sep 04 15:57:54 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_f_ref1tcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8bc89a29-5f53-452c-839a-5be0d99b3703" returned: 0 in 2.324s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_f_ref1tcdevstack@QuobyteHD, size 112.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8bc89a29-5f53-452c-839a-5be0d99b3703 {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 15:57:54 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Converted 112.00 MB image at 48.18 MB/s
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8bc89a29-5f53-452c-839a-5be0d99b3703 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:54 devstack sudo[99059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8bc89a29-5f53-452c-839a-5be0d99b3703 1G
Sep 04 15:57:54 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:54 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-360f7a76-715f-4a5b-bd4e-1fd96c755f8f" returned: 0 in 0.274s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.327s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1720210685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ec817d-5e2d-4953-8e91-150c75f0ae23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf4942e362e4e80b9e67cd0f8c8fa7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:54Z,use_quota=True,user_id='90d5e85a72624a96955885229bac933b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Creating volume c8ec817d-5e2d-4953-8e91-150c75f0ae23 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:57:54 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d5acc0-3275-4380-bb09-04422ac6646f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-360f7a76-715f-4a5b-bd4e-1fd96c755f8f', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:54 devstack sudo[99062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23 1073741824
Sep 04 15:57:54 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beaecdf6-dfd0-4506-9f5b-73333bfe6bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:54 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Volume volume-360f7a76-715f-4a5b-bd4e-1fd96c755f8f (360f7a76-715f-4a5b-bd4e-1fd96c755f8f): created successfully
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beaecdf6-dfd0-4506-9f5b-73333bfe6bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Flow 'volume_create_manager' (c6636ffd-40e3-4ad3-b805-b0195a0d81cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:54 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-41a39967-1aef-4f6e-bb32-22f97d218c03 tempest-VolumesServicesTestJSON-633989416 None] Created volume successfully.
Sep 04 15:57:54 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8bc89a29-5f53-452c-839a-5be0d99b3703 1G" returned: 0 in 0.334s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Downloaded image 9488c80e-bb64-48e5-b1fb-9998fd167822 ((None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}])) to volume 8bc89a29-5f53-452c-839a-5be0d99b3703 successfully. {{(pid=87504) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Temporary image 9488c80e-bb64-48e5-b1fb-9998fd167822 for user 71aaedd9a29b44df9edb60fbb98be877 is deleted. {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Marking volume 8bc89a29-5f53-452c-839a-5be0d99b3703 as bootable. {{(pid=87504) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Copying metadata from image 9488c80e-bb64-48e5-b1fb-9998fd167822 to 8bc89a29-5f53-452c-839a-5be0d99b3703. {{(pid=87504) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Creating volume glance metadata for volume 8bc89a29-5f53-452c-839a-5be0d99b3703 backed by image 9488c80e-bb64-48e5-b1fb-9998fd167822 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87504) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (623adb19-689a-4a24-bcf5-702c8c18835f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bc89a29-5f53-452c-839a-5be0d99b3703', 'volume_size': 1, 'image_id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f6dbd3908a2d48468b7f486df9705903', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9488c80e-bb64-48e5-b1fb-9998fd167822/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1a2c9ddc0>}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee31c1e-7d8d-417a-90b6-c93d7b602b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:54 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Volume volume-8bc89a29-5f53-452c-839a-5be0d99b3703 (8bc89a29-5f53-452c-839a-5be0d99b3703): created successfully
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee31c1e-7d8d-417a-90b6-c93d7b602b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Flow 'volume_create_manager' (7c0d3431-eb0e-4797-b037-6a49bf3853d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:54 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-49c1a48d-765c-456c-b54a-2cf9d0e02b50 tempest-VolumesGetTest-886688485 None] Created volume successfully.
Sep 04 15:57:54 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23 1073741824" returned: 0 in 0.460s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:54 devstack sudo[99070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23
Sep 04 15:57:54 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:55 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23" returned: 0 in 0.281s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:57:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351f040b-088a-43dc-a8c0-f5d5b99fbebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303f085e-cf76-473c-bea8-cd7feaf2b6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:55 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Volume volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23 (c8ec817d-5e2d-4953-8e91-150c75f0ae23): created successfully
Sep 04 15:57:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303f085e-cf76-473c-bea8-cd7feaf2b6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Flow 'volume_create_manager' (9f36dd73-8ecc-40e3-af02-93d3125cd946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:55 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-fe7edf2d-d3f5-4024-a097-cf0dff874192 tempest-VolumesExtendTest-546575527 None] Created volume successfully.
Sep 04 15:57:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9be5e9ad-fd76-404d-9616-1d005359eb96 tempest-VolumesServicesTestJSON-633989416 None] Acquiring lock "cinder-360f7a76-715f-4a5b-bd4e-1fd96c755f8f-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9be5e9ad-fd76-404d-9616-1d005359eb96 tempest-VolumesServicesTestJSON-633989416 None] Lock "cinder-360f7a76-715f-4a5b-bd4e-1fd96c755f8f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9be5e9ad-fd76-404d-9616-1d005359eb96 tempest-VolumesServicesTestJSON-633989416 None] Acquiring lock "cinder-quobyte-360f7a76-715f-4a5b-bd4e-1fd96c755f8f" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9be5e9ad-fd76-404d-9616-1d005359eb96 tempest-VolumesServicesTestJSON-633989416 None] Lock "cinder-quobyte-360f7a76-715f-4a5b-bd4e-1fd96c755f8f" acquired by "delete_volume" :: waited 0.022s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:55 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bad525-ef00-4de7-9565-70202fe2026b]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9be5e9ad-fd76-404d-9616-1d005359eb96 tempest-VolumesServicesTestJSON-633989416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-360f7a76-715f-4a5b-bd4e-1fd96c755f8f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:55 devstack sudo[99073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-360f7a76-715f-4a5b-bd4e-1fd96c755f8f
Sep 04 15:57:55 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:55 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:57:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Flow 'volume_create_manager' (857ea3c1-2072-42a6-9734-3d6bdf6bbdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b3c80ea-2c3e-4932-b8ae-05424d657b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b3c80ea-2c3e-4932-b8ae-05424d657b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2095588479',display_name='tempest-VolumesGetTest-Volume-2094768074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b6be35-04a3-4e98-b65e-8d0f6e09ab22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6c277473a44f819a2785f8e459d058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:56Z,use_quota=True,user_id='71aaedd9a29b44df9edb60fbb98be877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ec5955-5a40-4bb4-ac91-497a62085596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ec5955-5a40-4bb4-ac91-497a62085596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5fd57f-4746-4b5d-8e74-396c4e62f357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5fd57f-4746-4b5d-8e74-396c4e62f357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31b6be35-04a3-4e98-b65e-8d0f6e09ab22', 'volume_name': 'volume-31b6be35-04a3-4e98-b65e-8d0f6e09ab22', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b24da2f6-498a-47b4-b0b2-3d8923241e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b24da2f6-498a-47b4-b0b2-3d8923241e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c88a05-a2a0-4335-8e1f-11f7e4e5f16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:56 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Volume 31b6be35-04a3-4e98-b65e-8d0f6e09ab22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31b6be35-04a3-4e98-b65e-8d0f6e09ab22', 'volume_size': 1}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:57:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2095588479',display_name='tempest-VolumesGetTest-Volume-2094768074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b6be35-04a3-4e98-b65e-8d0f6e09ab22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6c277473a44f819a2785f8e459d058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:56Z,use_quota=True,user_id='71aaedd9a29b44df9edb60fbb98be877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Creating volume 31b6be35-04a3-4e98-b65e-8d0f6e09ab22 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:57:56 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-31b6be35-04a3-4e98-b65e-8d0f6e09ab22 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:56 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9be5e9ad-fd76-404d-9616-1d005359eb96 tempest-VolumesServicesTestJSON-633989416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-360f7a76-715f-4a5b-bd4e-1fd96c755f8f" returned: 0 in 0.530s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9be5e9ad-fd76-404d-9616-1d005359eb96 tempest-VolumesServicesTestJSON-633989416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-360f7a76-715f-4a5b-bd4e-1fd96c755f8f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:56 devstack sudo[99079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-31b6be35-04a3-4e98-b65e-8d0f6e09ab22 1073741824
Sep 04 15:57:56 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fb181f10-b950-4f41-9ccd-4ebf2fc34e24 tempest-VolumesExtendTest-546575527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:56 devstack sudo[99080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-360f7a76-715f-4a5b-bd4e-1fd96c755f8f
Sep 04 15:57:56 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:56 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9be5e9ad-fd76-404d-9616-1d005359eb96 tempest-VolumesServicesTestJSON-633989416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-360f7a76-715f-4a5b-bd4e-1fd96c755f8f" returned: 0 in 0.342s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9be5e9ad-fd76-404d-9616-1d005359eb96 tempest-VolumesServicesTestJSON-633989416 None] Lock "cinder-quobyte-360f7a76-715f-4a5b-bd4e-1fd96c755f8f" released by "delete_volume" :: held 0.929s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-9be5e9ad-fd76-404d-9616-1d005359eb96 tempest-VolumesServicesTestJSON-633989416 None] Created reservations ['fd4790bc-e668-4219-9fb8-db9e1a6e9ad2', 'bbee8dde-dc30-404e-8b3a-8e4f3d764187', '89640ea6-fafd-49d4-adbf-ec76cd3eb5de', 'a95f7855-5cc9-4093-a60c-60ef2913eff1'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9be5e9ad-fd76-404d-9616-1d005359eb96 tempest-VolumesServicesTestJSON-633989416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9be5e9ad-fd76-404d-9616-1d005359eb96 tempest-VolumesServicesTestJSON-633989416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9be5e9ad-fd76-404d-9616-1d005359eb96 tempest-VolumesServicesTestJSON-633989416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9be5e9ad-fd76-404d-9616-1d005359eb96 tempest-VolumesServicesTestJSON-633989416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9be5e9ad-fd76-404d-9616-1d005359eb96 tempest-VolumesServicesTestJSON-633989416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9be5e9ad-fd76-404d-9616-1d005359eb96 tempest-VolumesServicesTestJSON-633989416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:56 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-31b6be35-04a3-4e98-b65e-8d0f6e09ab22 1073741824" returned: 0 in 0.611s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:56 devstack sudo[99088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:57:56 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-31b6be35-04a3-4e98-b65e-8d0f6e09ab22 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:56 devstack sudo[99090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-31b6be35-04a3-4e98-b65e-8d0f6e09ab22
Sep 04 15:57:56 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:57 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9be5e9ad-fd76-404d-9616-1d005359eb96 tempest-VolumesServicesTestJSON-633989416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.354s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:57 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-9be5e9ad-fd76-404d-9616-1d005359eb96 tempest-VolumesServicesTestJSON-633989416 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:57:57 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-9be5e9ad-fd76-404d-9616-1d005359eb96 tempest-VolumesServicesTestJSON-633989416 None] Deleted volume successfully.
Sep 04 15:57:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9be5e9ad-fd76-404d-9616-1d005359eb96 tempest-VolumesServicesTestJSON-633989416 None] Lock "cinder-360f7a76-715f-4a5b-bd4e-1fd96c755f8f-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:57 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-31b6be35-04a3-4e98-b65e-8d0f6e09ab22" returned: 0 in 0.361s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:57 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:57:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fb181f10-b950-4f41-9ccd-4ebf2fc34e24 tempest-VolumesExtendTest-546575527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.955s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c88a05-a2a0-4335-8e1f-11f7e4e5f16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31b6be35-04a3-4e98-b65e-8d0f6e09ab22', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c583f1f-eef9-49c8-bb29-5a18fed21651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:57:57 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-fb181f10-b950-4f41-9ccd-4ebf2fc34e24 tempest-VolumesExtendTest-546575527 None] Creating offline snapshot 73adf101-d91a-494d-97aa-d3f406cb2dc7 of volume c8ec817d-5e2d-4953-8e91-150c75f0ae23 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:57:57 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Volume volume-31b6be35-04a3-4e98-b65e-8d0f6e09ab22 (31b6be35-04a3-4e98-b65e-8d0f6e09ab22): created successfully
Sep 04 15:57:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c583f1f-eef9-49c8-bb29-5a18fed21651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:57:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Flow 'volume_create_manager' (857ea3c1-2072-42a6-9734-3d6bdf6bbdf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:57:57 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[139655cb-f8f8-42a5-8834-697117a02d3b]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb181f10-b950-4f41-9ccd-4ebf2fc34e24 tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:57 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-cc74e391-bae4-422e-a5dd-2e244195520f tempest-VolumesGetTest-886688485 None] Created volume successfully.
Sep 04 15:57:57 devstack sudo[99094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23
Sep 04 15:57:57 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:57 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb181f10-b950-4f41-9ccd-4ebf2fc34e24 tempest-VolumesExtendTest-546575527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23" returned: 0 in 0.404s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb181f10-b950-4f41-9ccd-4ebf2fc34e24 tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.73adf101-d91a-494d-97aa-d3f406cb2dc7 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:57 devstack sudo[99099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.73adf101-d91a-494d-97aa-d3f406cb2dc7 1G
Sep 04 15:57:57 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:58 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb181f10-b950-4f41-9ccd-4ebf2fc34e24 tempest-VolumesExtendTest-546575527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.73adf101-d91a-494d-97aa-d3f406cb2dc7 1G" returned: 0 in 0.529s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb181f10-b950-4f41-9ccd-4ebf2fc34e24 tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.73adf101-d91a-494d-97aa-d3f406cb2dc7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:58 devstack sudo[99105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.73adf101-d91a-494d-97aa-d3f406cb2dc7
Sep 04 15:57:58 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:58 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e3a4868b-8525-494d-b9e9-f0e54420ff19 tempest-VolumesGetTest-886688485 None] Acquiring lock "cinder-31b6be35-04a3-4e98-b65e-8d0f6e09ab22-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:58 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e3a4868b-8525-494d-b9e9-f0e54420ff19 tempest-VolumesGetTest-886688485 None] Lock "cinder-31b6be35-04a3-4e98-b65e-8d0f6e09ab22-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:58 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e3a4868b-8525-494d-b9e9-f0e54420ff19 tempest-VolumesGetTest-886688485 None] Acquiring lock "cinder-quobyte-31b6be35-04a3-4e98-b65e-8d0f6e09ab22" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:58 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e3a4868b-8525-494d-b9e9-f0e54420ff19 tempest-VolumesGetTest-886688485 None] Lock "cinder-quobyte-31b6be35-04a3-4e98-b65e-8d0f6e09ab22" acquired by "delete_volume" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:58 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec536dd-c0ee-41b6-92d7-5be86d5de09d]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:57:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e3a4868b-8525-494d-b9e9-f0e54420ff19 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-31b6be35-04a3-4e98-b65e-8d0f6e09ab22 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:58 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb181f10-b950-4f41-9ccd-4ebf2fc34e24 tempest-VolumesExtendTest-546575527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.73adf101-d91a-494d-97aa-d3f406cb2dc7" returned: 0 in 0.415s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:58 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-fb181f10-b950-4f41-9ccd-4ebf2fc34e24 tempest-VolumesExtendTest-546575527 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.73adf101-d91a-494d-97aa-d3f406cb2dc7 is being set with open permissions: ugo+rw
Sep 04 15:57:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb181f10-b950-4f41-9ccd-4ebf2fc34e24 tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.73adf101-d91a-494d-97aa-d3f406cb2dc7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:58 devstack sudo[99111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.73adf101-d91a-494d-97aa-d3f406cb2dc7
Sep 04 15:57:58 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:58 devstack sudo[99110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-31b6be35-04a3-4e98-b65e-8d0f6e09ab22
Sep 04 15:57:58 devstack sudo[99110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:58 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb181f10-b950-4f41-9ccd-4ebf2fc34e24 tempest-VolumesExtendTest-546575527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.73adf101-d91a-494d-97aa-d3f406cb2dc7" returned: 0 in 0.318s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb181f10-b950-4f41-9ccd-4ebf2fc34e24 tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:58 devstack sudo[99118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.info
Sep 04 15:57:58 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:58 devstack sudo[99110]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e3a4868b-8525-494d-b9e9-f0e54420ff19 tempest-VolumesGetTest-886688485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-31b6be35-04a3-4e98-b65e-8d0f6e09ab22" returned: 0 in 0.474s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e3a4868b-8525-494d-b9e9-f0e54420ff19 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-31b6be35-04a3-4e98-b65e-8d0f6e09ab22 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:59 devstack sudo[99120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-31b6be35-04a3-4e98-b65e-8d0f6e09ab22
Sep 04 15:57:59 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:59 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb181f10-b950-4f41-9ccd-4ebf2fc34e24 tempest-VolumesExtendTest-546575527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.info" returned: 0 in 0.331s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:59 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-fb181f10-b950-4f41-9ccd-4ebf2fc34e24 tempest-VolumesExtendTest-546575527 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.info is being set with open permissions: ugo+rw
Sep 04 15:57:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb181f10-b950-4f41-9ccd-4ebf2fc34e24 tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:59 devstack sudo[99124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.info
Sep 04 15:57:59 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:59 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e3a4868b-8525-494d-b9e9-f0e54420ff19 tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-31b6be35-04a3-4e98-b65e-8d0f6e09ab22" returned: 0 in 0.353s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e3a4868b-8525-494d-b9e9-f0e54420ff19 tempest-VolumesGetTest-886688485 None] Lock "cinder-quobyte-31b6be35-04a3-4e98-b65e-8d0f6e09ab22" released by "delete_volume" :: held 0.897s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:57:59 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-e3a4868b-8525-494d-b9e9-f0e54420ff19 tempest-VolumesGetTest-886688485 None] Created reservations ['1c17c835-d98b-47b0-908c-d25ce9a1af6c', '3e04baa4-e6fd-4ae2-926d-e55d943e9edb', '309d29ab-0834-4de5-aefe-e3f41cf7180b', '1b1fd347-943d-415c-9831-74c7ffdea235'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:57:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e3a4868b-8525-494d-b9e9-f0e54420ff19 tempest-VolumesGetTest-886688485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:57:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e3a4868b-8525-494d-b9e9-f0e54420ff19 tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:57:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e3a4868b-8525-494d-b9e9-f0e54420ff19 tempest-VolumesGetTest-886688485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:57:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e3a4868b-8525-494d-b9e9-f0e54420ff19 tempest-VolumesGetTest-886688485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:57:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e3a4868b-8525-494d-b9e9-f0e54420ff19 tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e3a4868b-8525-494d-b9e9-f0e54420ff19 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:57:59 devstack sudo[99126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:57:59 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:57:59 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root
Sep 04 15:57:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb181f10-b950-4f41-9ccd-4ebf2fc34e24 tempest-VolumesExtendTest-546575527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.info" returned: 0 in 0.466s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:57:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fb181f10-b950-4f41-9ccd-4ebf2fc34e24 tempest-VolumesExtendTest-546575527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.617s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:57:59 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-fb181f10-b950-4f41-9ccd-4ebf2fc34e24 tempest-VolumesExtendTest-546575527 None] Create snapshot completed successfully
Sep 04 15:57:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ee0c5963-eff6-4ea6-b35f-bc0abcf50064 tempest-VolumesGetTest-886688485 None] Acquiring lock "cinder-8bc89a29-5f53-452c-839a-5be0d99b3703-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ee0c5963-eff6-4ea6-b35f-bc0abcf50064 tempest-VolumesGetTest-886688485 None] Lock "cinder-8bc89a29-5f53-452c-839a-5be0d99b3703-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:57:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ee0c5963-eff6-4ea6-b35f-bc0abcf50064 tempest-VolumesGetTest-886688485 None] Acquiring lock "cinder-quobyte-8bc89a29-5f53-452c-839a-5be0d99b3703" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:57:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ee0c5963-eff6-4ea6-b35f-bc0abcf50064 tempest-VolumesGetTest-886688485 None] Lock "cinder-quobyte-8bc89a29-5f53-452c-839a-5be0d99b3703" acquired by "delete_volume" :: waited 0.032s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:00 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60402f9-cdb9-4c2c-8352-f48d71e1ec82]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ee0c5963-eff6-4ea6-b35f-bc0abcf50064 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8bc89a29-5f53-452c-839a-5be0d99b3703 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:00 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e3a4868b-8525-494d-b9e9-f0e54420ff19 tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.452s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:00 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-e3a4868b-8525-494d-b9e9-f0e54420ff19 tempest-VolumesGetTest-886688485 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:58:00 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e3a4868b-8525-494d-b9e9-f0e54420ff19 tempest-VolumesGetTest-886688485 None] Deleted volume successfully.
Sep 04 15:58:00 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e3a4868b-8525-494d-b9e9-f0e54420ff19 tempest-VolumesGetTest-886688485 None] Lock "cinder-31b6be35-04a3-4e98-b65e-8d0f6e09ab22-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:00 devstack sudo[99130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8bc89a29-5f53-452c-839a-5be0d99b3703
Sep 04 15:58:00 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:00 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ee0c5963-eff6-4ea6-b35f-bc0abcf50064 tempest-VolumesGetTest-886688485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8bc89a29-5f53-452c-839a-5be0d99b3703" returned: 0 in 0.553s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ee0c5963-eff6-4ea6-b35f-bc0abcf50064 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8bc89a29-5f53-452c-839a-5be0d99b3703 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3a658b67-5b34-4516-a04d-c747a46c9109 tempest-VolumesExtendTest-546575527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3a658b67-5b34-4516-a04d-c747a46c9109 tempest-VolumesExtendTest-546575527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:00 devstack sudo[99135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8bc89a29-5f53-452c-839a-5be0d99b3703
Sep 04 15:58:00 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:00 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[299e453e-c2f8-4360-bb99-83683d71004f]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3a658b67-5b34-4516-a04d-c747a46c9109 tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:00 devstack sudo[99137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23
Sep 04 15:58:00 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:00 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ee0c5963-eff6-4ea6-b35f-bc0abcf50064 tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8bc89a29-5f53-452c-839a-5be0d99b3703" returned: 0 in 0.356s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:00 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ee0c5963-eff6-4ea6-b35f-bc0abcf50064 tempest-VolumesGetTest-886688485 None] Lock "cinder-quobyte-8bc89a29-5f53-452c-839a-5be0d99b3703" released by "delete_volume" :: held 0.965s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:01 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-ee0c5963-eff6-4ea6-b35f-bc0abcf50064 tempest-VolumesGetTest-886688485 None] Created reservations ['c6d62001-0a29-4095-a5e4-b2a00209babc', '21b95206-ece2-473c-8039-a21e4bd5a460', 'aea1d2c3-f51b-47b0-8b5c-6643319104a4', '018d5f51-01f8-467f-a4e7-5b1a6106a6a9'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:58:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ee0c5963-eff6-4ea6-b35f-bc0abcf50064 tempest-VolumesGetTest-886688485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ee0c5963-eff6-4ea6-b35f-bc0abcf50064 tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:01 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ee0c5963-eff6-4ea6-b35f-bc0abcf50064 tempest-VolumesGetTest-886688485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:01 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ee0c5963-eff6-4ea6-b35f-bc0abcf50064 tempest-VolumesGetTest-886688485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ee0c5963-eff6-4ea6-b35f-bc0abcf50064 tempest-VolumesGetTest-886688485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ee0c5963-eff6-4ea6-b35f-bc0abcf50064 tempest-VolumesGetTest-886688485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:01 devstack sudo[99154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:58:01 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:01 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3a658b67-5b34-4516-a04d-c747a46c9109 tempest-VolumesExtendTest-546575527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23" returned: 0 in 0.599s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3a658b67-5b34-4516-a04d-c747a46c9109 tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.73adf101-d91a-494d-97aa-d3f406cb2dc7 2G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3a658b67-5b34-4516-a04d-c747a46c9109 tempest-VolumesExtendTest-546575527 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.73adf101-d91a-494d-97aa-d3f406cb2dc7 2G" returned: 0 in 0.228s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3a658b67-5b34-4516-a04d-c747a46c9109 tempest-VolumesExtendTest-546575527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.891s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:01 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-3a658b67-5b34-4516-a04d-c747a46c9109 tempest-VolumesExtendTest-546575527 None] Extend volume completed successfully.
Sep 04 15:58:01 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ee0c5963-eff6-4ea6-b35f-bc0abcf50064 tempest-VolumesGetTest-886688485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.564s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:01 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ee0c5963-eff6-4ea6-b35f-bc0abcf50064 tempest-VolumesGetTest-886688485 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:58:01 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-ee0c5963-eff6-4ea6-b35f-bc0abcf50064 tempest-VolumesGetTest-886688485 None] Deleted volume successfully.
Sep 04 15:58:01 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ee0c5963-eff6-4ea6-b35f-bc0abcf50064 tempest-VolumesGetTest-886688485 None] Lock "cinder-8bc89a29-5f53-452c-839a-5be0d99b3703-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:01 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fe3d4b32-00b8-4573-ba87-9f08a3d19f7f tempest-VolumesExtendTest-546575527 None] Acquiring lock "cinder-73adf101-d91a-494d-97aa-d3f406cb2dc7-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:01 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fe3d4b32-00b8-4573-ba87-9f08a3d19f7f tempest-VolumesExtendTest-546575527 None] Lock "cinder-73adf101-d91a-494d-97aa-d3f406cb2dc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:01 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fe3d4b32-00b8-4573-ba87-9f08a3d19f7f tempest-VolumesExtendTest-546575527 None] Acquiring lock "cinder-quobyte-c8ec817d-5e2d-4953-8e91-150c75f0ae23" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:01 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fe3d4b32-00b8-4573-ba87-9f08a3d19f7f tempest-VolumesExtendTest-546575527 None] Lock "cinder-quobyte-c8ec817d-5e2d-4953-8e91-150c75f0ae23" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:01 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fe3d4b32-00b8-4573-ba87-9f08a3d19f7f tempest-VolumesExtendTest-546575527 None] Acquiring lock "cinder-quobyte-73adf101-d91a-494d-97aa-d3f406cb2dc7" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:01 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fe3d4b32-00b8-4573-ba87-9f08a3d19f7f tempest-VolumesExtendTest-546575527 None] Lock "cinder-quobyte-73adf101-d91a-494d-97aa-d3f406cb2dc7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:01 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-fe3d4b32-00b8-4573-ba87-9f08a3d19f7f tempest-VolumesExtendTest-546575527 None] Deleting offline snapshot 73adf101-d91a-494d-97aa-d3f406cb2dc7 of volume c8ec817d-5e2d-4953-8e91-150c75f0ae23 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 15:58:02 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-fe3d4b32-00b8-4573-ba87-9f08a3d19f7f tempest-VolumesExtendTest-546575527 None] snapshot_file for this snap is: volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.73adf101-d91a-494d-97aa-d3f406cb2dc7 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 15:58:02 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27193e9-8120-4ede-8af7-e129b22d512b]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fe3d4b32-00b8-4573-ba87-9f08a3d19f7f tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.73adf101-d91a-494d-97aa-d3f406cb2dc7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:02 devstack sudo[99186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.73adf101-d91a-494d-97aa-d3f406cb2dc7
Sep 04 15:58:02 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:02 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fe3d4b32-00b8-4573-ba87-9f08a3d19f7f tempest-VolumesExtendTest-546575527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.73adf101-d91a-494d-97aa-d3f406cb2dc7" returned: 0 in 0.457s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:02 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-fe3d4b32-00b8-4573-ba87-9f08a3d19f7f tempest-VolumesExtendTest-546575527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:58:02 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1266df-d5a5-4d90-b35f-813f232a6cd8]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fe3d4b32-00b8-4573-ba87-9f08a3d19f7f tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:02 devstack sudo[99191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23
Sep 04 15:58:02 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:03 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fe3d4b32-00b8-4573-ba87-9f08a3d19f7f tempest-VolumesExtendTest-546575527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23" returned: 0 in 0.520s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fe3d4b32-00b8-4573-ba87-9f08a3d19f7f tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.73adf101-d91a-494d-97aa-d3f406cb2dc7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:03 devstack sudo[99196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.73adf101-d91a-494d-97aa-d3f406cb2dc7
Sep 04 15:58:03 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:03 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fe3d4b32-00b8-4573-ba87-9f08a3d19f7f tempest-VolumesExtendTest-546575527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.73adf101-d91a-494d-97aa-d3f406cb2dc7" returned: 0 in 0.589s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fe3d4b32-00b8-4573-ba87-9f08a3d19f7f tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.73adf101-d91a-494d-97aa-d3f406cb2dc7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:03 devstack sudo[99202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.73adf101-d91a-494d-97aa-d3f406cb2dc7
Sep 04 15:58:03 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:04 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fe3d4b32-00b8-4573-ba87-9f08a3d19f7f tempest-VolumesExtendTest-546575527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23.73adf101-d91a-494d-97aa-d3f406cb2dc7" returned: 0 in 0.376s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:04 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fe3d4b32-00b8-4573-ba87-9f08a3d19f7f tempest-VolumesExtendTest-546575527 None] Lock "cinder-quobyte-73adf101-d91a-494d-97aa-d3f406cb2dc7" released by "_delete_snapshot" :: held 2.127s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:04 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fe3d4b32-00b8-4573-ba87-9f08a3d19f7f tempest-VolumesExtendTest-546575527 None] Lock "cinder-quobyte-c8ec817d-5e2d-4953-8e91-150c75f0ae23" released by "delete_snapshot" :: held 2.156s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:04 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-fe3d4b32-00b8-4573-ba87-9f08a3d19f7f tempest-VolumesExtendTest-546575527 None] Created reservations ['eb4cabdd-0c68-467c-ac45-5a0156e9a9cf', '732c601e-f12b-4a49-bfa5-d77f5e972686', 'b543c029-3820-4a88-abcc-32f3d9d01a66', 'a858a95b-8d87-4140-a67f-4b29de180a5e'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:58:04 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-fe3d4b32-00b8-4573-ba87-9f08a3d19f7f tempest-VolumesExtendTest-546575527 None] Delete snapshot completed successfully.
Sep 04 15:58:04 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fe3d4b32-00b8-4573-ba87-9f08a3d19f7f tempest-VolumesExtendTest-546575527 None] Lock "cinder-73adf101-d91a-494d-97aa-d3f406cb2dc7-delete_snapshot" released by "delete_snapshot" :: held 2.386s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:05 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b443fbc1-a3af-4d8c-90bd-e545288f381c tempest-VolumesExtendTest-546575527 None] Acquiring lock "cinder-c8ec817d-5e2d-4953-8e91-150c75f0ae23-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:05 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b443fbc1-a3af-4d8c-90bd-e545288f381c tempest-VolumesExtendTest-546575527 None] Lock "cinder-c8ec817d-5e2d-4953-8e91-150c75f0ae23-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:05 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b443fbc1-a3af-4d8c-90bd-e545288f381c tempest-VolumesExtendTest-546575527 None] Acquiring lock "cinder-quobyte-c8ec817d-5e2d-4953-8e91-150c75f0ae23" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:05 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b443fbc1-a3af-4d8c-90bd-e545288f381c tempest-VolumesExtendTest-546575527 None] Lock "cinder-quobyte-c8ec817d-5e2d-4953-8e91-150c75f0ae23" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:05 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f0dd7e-f7f9-4e5d-85c8-68476ee6fcf1]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b443fbc1-a3af-4d8c-90bd-e545288f381c tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:05 devstack sudo[99206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23
Sep 04 15:58:05 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:06 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b443fbc1-a3af-4d8c-90bd-e545288f381c tempest-VolumesExtendTest-546575527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23" returned: 0 in 0.562s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b443fbc1-a3af-4d8c-90bd-e545288f381c tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:06 devstack sudo[99212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23
Sep 04 15:58:06 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:06 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b443fbc1-a3af-4d8c-90bd-e545288f381c tempest-VolumesExtendTest-546575527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8ec817d-5e2d-4953-8e91-150c75f0ae23" returned: 0 in 0.360s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b443fbc1-a3af-4d8c-90bd-e545288f381c tempest-VolumesExtendTest-546575527 None] Lock "cinder-quobyte-c8ec817d-5e2d-4953-8e91-150c75f0ae23" released by "delete_volume" :: held 1.066s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:06 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-b443fbc1-a3af-4d8c-90bd-e545288f381c tempest-VolumesExtendTest-546575527 None] Created reservations ['54daf3bc-c5e1-4307-87c3-aff87bfe85d1', '87ecbe53-bb18-40be-a75c-a7a36550be34', '5861662a-a5a7-4d59-9be7-d31ba5e8ab4b', '9c1dd3e5-7c43-4adc-8bb4-03833a548569'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:58:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b443fbc1-a3af-4d8c-90bd-e545288f381c tempest-VolumesExtendTest-546575527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b443fbc1-a3af-4d8c-90bd-e545288f381c tempest-VolumesExtendTest-546575527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b443fbc1-a3af-4d8c-90bd-e545288f381c tempest-VolumesExtendTest-546575527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b443fbc1-a3af-4d8c-90bd-e545288f381c tempest-VolumesExtendTest-546575527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b443fbc1-a3af-4d8c-90bd-e545288f381c tempest-VolumesExtendTest-546575527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b443fbc1-a3af-4d8c-90bd-e545288f381c tempest-VolumesExtendTest-546575527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:06 devstack sudo[99215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:58:06 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:58:07 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Flow 'volume_create_manager' (c99e3bbb-2623-4c88-92c5-e4095468e035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac3f2d6-38ff-4f4e-98e8-fba7ebbbb378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b443fbc1-a3af-4d8c-90bd-e545288f381c tempest-VolumesExtendTest-546575527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.467s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-b443fbc1-a3af-4d8c-90bd-e545288f381c tempest-VolumesExtendTest-546575527 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:58:07 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-b443fbc1-a3af-4d8c-90bd-e545288f381c tempest-VolumesExtendTest-546575527 None] Deleted volume successfully.
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac3f2d6-38ff-4f4e-98e8-fba7ebbbb378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1238685315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38bd76bb-82df-4883-ac23-8659578aab37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306b909397994ac3b324acf9c940807b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:07Z,use_quota=True,user_id='6892e74303ed49358f60524965c21eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df117206-7abc-4296-a919-dd6e2d568437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df117206-7abc-4296-a919-dd6e2d568437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f8fda9-f67b-458b-aed1-9b2ebe5ff2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f8fda9-f67b-458b-aed1-9b2ebe5ff2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38bd76bb-82df-4883-ac23-8659578aab37', 'volume_name': 'volume-38bd76bb-82df-4883-ac23-8659578aab37', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9adcee5c-0ba5-467b-90a0-1d7ecbd64b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9adcee5c-0ba5-467b-90a0-1d7ecbd64b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34346c28-a639-41d8-bc20-f9cab0c60824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:07 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Volume 38bd76bb-82df-4883-ac23-8659578aab37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38bd76bb-82df-4883-ac23-8659578aab37', 'volume_size': 1}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1238685315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38bd76bb-82df-4883-ac23-8659578aab37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306b909397994ac3b324acf9c940807b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:07Z,use_quota=True,user_id='6892e74303ed49358f60524965c21eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Creating volume 38bd76bb-82df-4883-ac23-8659578aab37 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:58:07 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b443fbc1-a3af-4d8c-90bd-e545288f381c tempest-VolumesExtendTest-546575527 None] Lock "cinder-c8ec817d-5e2d-4953-8e91-150c75f0ae23-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:07 devstack sudo[99218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37 1073741824
Sep 04 15:58:07 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Flow 'volume_create_manager' (a17ee3f5-1902-4448-b6a9-8457a91cac74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (513e8f33-bc30-4e92-9658-08d3b711cad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (513e8f33-bc30-4e92-9658-08d3b711cad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1393280900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7297f787-e569-42f5-97de-bacb9e936cec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bb303ce30f64ebdbe6d41c5bccc7540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:08Z,use_quota=True,user_id='7775cb9b255f42f3b54487a6ea1b576f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c000a05-5a2a-4c8c-a393-3b81325d4813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c000a05-5a2a-4c8c-a393-3b81325d4813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bad9277-bd52-4cc7-979d-7d9603b8b28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bad9277-bd52-4cc7-979d-7d9603b8b28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7297f787-e569-42f5-97de-bacb9e936cec', 'volume_name': 'volume-7297f787-e569-42f5-97de-bacb9e936cec', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e969ea-740c-4c04-828d-af90f0b03375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e969ea-740c-4c04-828d-af90f0b03375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a5e5814-5dae-4a6a-ba4d-4bb60988cb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:07 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Volume 7297f787-e569-42f5-97de-bacb9e936cec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7297f787-e569-42f5-97de-bacb9e936cec', 'volume_size': 1}
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:07 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37 1073741824" returned: 0 in 0.529s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:08 devstack sudo[99224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37
Sep 04 15:58:08 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:08 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37" returned: 0 in 0.327s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:58:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.468s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1393280900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7297f787-e569-42f5-97de-bacb9e936cec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bb303ce30f64ebdbe6d41c5bccc7540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:08Z,use_quota=True,user_id='7775cb9b255f42f3b54487a6ea1b576f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:58:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Creating volume 7297f787-e569-42f5-97de-bacb9e936cec {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:58:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:58:08 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:58:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34346c28-a639-41d8-bc20-f9cab0c60824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38bd76bb-82df-4883-ac23-8659578aab37', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b10f6d0-0a1a-46d0-9902-daa2e4515dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:08 devstack sudo[99227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec 1073741824
Sep 04 15:58:08 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:08 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Volume volume-38bd76bb-82df-4883-ac23-8659578aab37 (38bd76bb-82df-4883-ac23-8659578aab37): created successfully
Sep 04 15:58:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b10f6d0-0a1a-46d0-9902-daa2e4515dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Flow 'volume_create_manager' (c99e3bbb-2623-4c88-92c5-e4095468e035) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:08 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-a7e47b08-a92b-466e-8a9d-506bb602742f tempest-VolumeDependencyTests-1800919807 None] Created volume successfully.
Sep 04 15:58:09 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec 1073741824" returned: 0 in 0.687s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:09 devstack sudo[99233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec
Sep 04 15:58:09 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:09 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec" returned: 0 in 0.310s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:09 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:58:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a5e5814-5dae-4a6a-ba4d-4bb60988cb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7297f787-e569-42f5-97de-bacb9e936cec', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cbd21d0-c5df-4083-a2e9-0fdc8f3e2e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:09 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Volume volume-7297f787-e569-42f5-97de-bacb9e936cec (7297f787-e569-42f5-97de-bacb9e936cec): created successfully
Sep 04 15:58:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cbd21d0-c5df-4083-a2e9-0fdc8f3e2e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Flow 'volume_create_manager' (a17ee3f5-1902-4448-b6a9-8457a91cac74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:09 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-52304f68-d064-427e-a179-791bc3bb101b tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Created volume successfully.
Sep 04 15:58:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cb1c1daa-eb43-444f-bb6b-8fd7cc703c3d tempest-VolumeDependencyTests-1800919807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cb1c1daa-eb43-444f-bb6b-8fd7cc703c3d tempest-VolumeDependencyTests-1800919807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:09 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-cb1c1daa-eb43-444f-bb6b-8fd7cc703c3d tempest-VolumeDependencyTests-1800919807 None] Creating offline snapshot 09c46b11-c85c-4042-a1a1-9920b6ef78ef of volume 38bd76bb-82df-4883-ac23-8659578aab37 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:58:09 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2237a4-b8d7-4210-8877-1c2665bc1066]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cb1c1daa-eb43-444f-bb6b-8fd7cc703c3d tempest-VolumeDependencyTests-1800919807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:09 devstack sudo[99236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37
Sep 04 15:58:09 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0b26a0f2-5643-4a43-a794-5418c277401f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:10 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cb1c1daa-eb43-444f-bb6b-8fd7cc703c3d tempest-VolumeDependencyTests-1800919807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37" returned: 0 in 0.544s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cb1c1daa-eb43-444f-bb6b-8fd7cc703c3d tempest-VolumeDependencyTests-1800919807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.09c46b11-c85c-4042-a1a1-9920b6ef78ef 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:10 devstack sudo[99241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.09c46b11-c85c-4042-a1a1-9920b6ef78ef 1G
Sep 04 15:58:10 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:10 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cb1c1daa-eb43-444f-bb6b-8fd7cc703c3d tempest-VolumeDependencyTests-1800919807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.09c46b11-c85c-4042-a1a1-9920b6ef78ef 1G" returned: 0 in 0.517s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cb1c1daa-eb43-444f-bb6b-8fd7cc703c3d tempest-VolumeDependencyTests-1800919807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38bd76bb-82df-4883-ac23-8659578aab37 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.09c46b11-c85c-4042-a1a1-9920b6ef78ef {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:10 devstack sudo[99247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38bd76bb-82df-4883-ac23-8659578aab37 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.09c46b11-c85c-4042-a1a1-9920b6ef78ef
Sep 04 15:58:10 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:11 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cb1c1daa-eb43-444f-bb6b-8fd7cc703c3d tempest-VolumeDependencyTests-1800919807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38bd76bb-82df-4883-ac23-8659578aab37 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.09c46b11-c85c-4042-a1a1-9920b6ef78ef" returned: 0 in 0.335s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:11 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-cb1c1daa-eb43-444f-bb6b-8fd7cc703c3d tempest-VolumeDependencyTests-1800919807 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.09c46b11-c85c-4042-a1a1-9920b6ef78ef is being set with open permissions: ugo+rw
Sep 04 15:58:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cb1c1daa-eb43-444f-bb6b-8fd7cc703c3d tempest-VolumeDependencyTests-1800919807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.09c46b11-c85c-4042-a1a1-9920b6ef78ef {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:11 devstack sudo[99252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.09c46b11-c85c-4042-a1a1-9920b6ef78ef
Sep 04 15:58:11 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:11 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cb1c1daa-eb43-444f-bb6b-8fd7cc703c3d tempest-VolumeDependencyTests-1800919807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.09c46b11-c85c-4042-a1a1-9920b6ef78ef" returned: 0 in 0.354s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cb1c1daa-eb43-444f-bb6b-8fd7cc703c3d tempest-VolumeDependencyTests-1800919807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:11 devstack sudo[99255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.info
Sep 04 15:58:11 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:11 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cb1c1daa-eb43-444f-bb6b-8fd7cc703c3d tempest-VolumeDependencyTests-1800919807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.info" returned: 0 in 0.307s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:11 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-cb1c1daa-eb43-444f-bb6b-8fd7cc703c3d tempest-VolumeDependencyTests-1800919807 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.info is being set with open permissions: ugo+rw
Sep 04 15:58:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cb1c1daa-eb43-444f-bb6b-8fd7cc703c3d tempest-VolumeDependencyTests-1800919807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:11 devstack sudo[99258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.info
Sep 04 15:58:11 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:12 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cb1c1daa-eb43-444f-bb6b-8fd7cc703c3d tempest-VolumeDependencyTests-1800919807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.info" returned: 0 in 0.276s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cb1c1daa-eb43-444f-bb6b-8fd7cc703c3d tempest-VolumeDependencyTests-1800919807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.446s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0b26a0f2-5643-4a43-a794-5418c277401f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.876s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-0b26a0f2-5643-4a43-a794-5418c277401f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Creating offline snapshot a2565fb1-ee07-43e9-9bfb-0102070cf322 of volume 7297f787-e569-42f5-97de-bacb9e936cec {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:58:12 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-cb1c1daa-eb43-444f-bb6b-8fd7cc703c3d tempest-VolumeDependencyTests-1800919807 None] Create snapshot completed successfully
Sep 04 15:58:12 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f83182d-f72d-43aa-87ea-e954716de9e8]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0b26a0f2-5643-4a43-a794-5418c277401f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:12 devstack sudo[99261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec
Sep 04 15:58:12 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:12 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0b26a0f2-5643-4a43-a794-5418c277401f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec" returned: 0 in 0.502s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0b26a0f2-5643-4a43-a794-5418c277401f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.a2565fb1-ee07-43e9-9bfb-0102070cf322 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:12 devstack sudo[99266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.a2565fb1-ee07-43e9-9bfb-0102070cf322 1G
Sep 04 15:58:12 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:13 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0b26a0f2-5643-4a43-a794-5418c277401f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.a2565fb1-ee07-43e9-9bfb-0102070cf322 1G" returned: 0 in 0.523s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0b26a0f2-5643-4a43-a794-5418c277401f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7297f787-e569-42f5-97de-bacb9e936cec -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.a2565fb1-ee07-43e9-9bfb-0102070cf322 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:13 devstack sudo[99273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7297f787-e569-42f5-97de-bacb9e936cec -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.a2565fb1-ee07-43e9-9bfb-0102070cf322
Sep 04 15:58:13 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:13 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:58:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Flow 'volume_create_manager' (f545bd03-ab27-4ee3-8a85-934f83323058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a594f2d-a76f-453b-82d8-6d1fc8d98147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a594f2d-a76f-453b-82d8-6d1fc8d98147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1857104877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f5080a-11f2-441f-9afa-62fea2322a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306b909397994ac3b324acf9c940807b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=09c46b11-c85c-4042-a1a1-9920b6ef78ef,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:13Z,use_quota=True,user_id='6892e74303ed49358f60524965c21eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:13 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ec872f-d5c4-48a3-a7a3-d2c2f9727343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ec872f-d5c4-48a3-a7a3-d2c2f9727343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7737be-c3e5-42c8-aa46-b444b591e65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7737be-c3e5-42c8-aa46-b444b591e65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '80f5080a-11f2-441f-9afa-62fea2322a58', 'volume_name': 'volume-80f5080a-11f2-441f-9afa-62fea2322a58', 'volume_size': 1, 'snapshot_id': '09c46b11-c85c-4042-a1a1-9920b6ef78ef'}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6560b721-6b91-4b00-8030-b96672791de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6560b721-6b91-4b00-8030-b96672791de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3dff511-368c-47d2-b9c8-9b0ce2115832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:13 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Volume 80f5080a-11f2-441f-9afa-62fea2322a58: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-80f5080a-11f2-441f-9afa-62fea2322a58', 'volume_size': 1, 'snapshot_id': '09c46b11-c85c-4042-a1a1-9920b6ef78ef'}
Sep 04 15:58:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0b26a0f2-5643-4a43-a794-5418c277401f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7297f787-e569-42f5-97de-bacb9e936cec -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.a2565fb1-ee07-43e9-9bfb-0102070cf322" returned: 0 in 0.491s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:13 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-0b26a0f2-5643-4a43-a794-5418c277401f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.a2565fb1-ee07-43e9-9bfb-0102070cf322 is being set with open permissions: ugo+rw
Sep 04 15:58:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0b26a0f2-5643-4a43-a794-5418c277401f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.a2565fb1-ee07-43e9-9bfb-0102070cf322 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:13 devstack sudo[99279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.a2565fb1-ee07-43e9-9bfb-0102070cf322
Sep 04 15:58:13 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:14 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0b26a0f2-5643-4a43-a794-5418c277401f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.a2565fb1-ee07-43e9-9bfb-0102070cf322" returned: 0 in 0.336s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0b26a0f2-5643-4a43-a794-5418c277401f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:14 devstack sudo[99283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.info
Sep 04 15:58:14 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:14 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0b26a0f2-5643-4a43-a794-5418c277401f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.info" returned: 0 in 0.305s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:14 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-0b26a0f2-5643-4a43-a794-5418c277401f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.info is being set with open permissions: ugo+rw
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0b26a0f2-5643-4a43-a794-5418c277401f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:14 devstack sudo[99286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.info
Sep 04 15:58:14 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:14 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0b26a0f2-5643-4a43-a794-5418c277401f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.info" returned: 0 in 0.302s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0b26a0f2-5643-4a43-a794-5418c277401f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.625s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.004s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Acquiring lock "cinder-quobyte-09c46b11-c85c-4042-a1a1-9920b6ef78ef-80f5080a-11f2-441f-9afa-62fea2322a58" by "_create_volume_from_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Lock "cinder-quobyte-09c46b11-c85c-4042-a1a1-9920b6ef78ef-80f5080a-11f2-441f-9afa-62fea2322a58" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Creating volume 80f5080a-11f2-441f-9afa-62fea2322a58 from snapshot 09c46b11-c85c-4042-a1a1-9920b6ef78ef {{(pid=87504) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Acquiring lock "cinder-quobyte-80f5080a-11f2-441f-9afa-62fea2322a58" by "_copy_volume_from_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:14 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-0b26a0f2-5643-4a43-a794-5418c277401f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Create snapshot completed successfully
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Lock "cinder-quobyte-80f5080a-11f2-441f-9afa-62fea2322a58" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] snapshot: 09c46b11-c85c-4042-a1a1-9920b6ef78ef, volume: 80f5080a-11f2-441f-9afa-62fea2322a58,  {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fa9562-352d-439c-a9d2-61c9db4cb541]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.09c46b11-c85c-4042-a1a1-9920b6ef78ef {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:14 devstack sudo[99289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.09c46b11-c85c-4042-a1a1-9920b6ef78ef
Sep 04 15:58:14 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:15 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.09c46b11-c85c-4042-a1a1-9920b6ef78ef" returned: 0 in 0.400s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:15 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38bd76bb-82df-4883-ac23-8659578aab37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:58:15 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccbb4e5-7207-475e-a748-0950bec36565]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:15 devstack sudo[99294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37
Sep 04 15:58:15 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:15 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37" returned: 0 in 0.497s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:15 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37 {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 04 15:58:15 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Creating direct copy from snapshot {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 04 15:58:15 devstack cinder-volume[87504]: DEBUG cinder.utils [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Path /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-80f5080a-11f2-441f-9afa-62fea2322a58 not found in is_blk_device check {{(pid=87504) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 04 15:58:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-80f5080a-11f2-441f-9afa-62fea2322a58 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:15 devstack sudo[99300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-80f5080a-11f2-441f-9afa-62fea2322a58
Sep 04 15:58:15 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4d5290fa-6092-4544-82d6-e1b9fe8acc7f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Acquiring lock "cinder-a2565fb1-ee07-43e9-9bfb-0102070cf322-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4d5290fa-6092-4544-82d6-e1b9fe8acc7f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Lock "cinder-a2565fb1-ee07-43e9-9bfb-0102070cf322-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4d5290fa-6092-4544-82d6-e1b9fe8acc7f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Acquiring lock "cinder-quobyte-7297f787-e569-42f5-97de-bacb9e936cec" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4d5290fa-6092-4544-82d6-e1b9fe8acc7f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Lock "cinder-quobyte-7297f787-e569-42f5-97de-bacb9e936cec" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4d5290fa-6092-4544-82d6-e1b9fe8acc7f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Acquiring lock "cinder-quobyte-a2565fb1-ee07-43e9-9bfb-0102070cf322" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4d5290fa-6092-4544-82d6-e1b9fe8acc7f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Lock "cinder-quobyte-a2565fb1-ee07-43e9-9bfb-0102070cf322" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-4d5290fa-6092-4544-82d6-e1b9fe8acc7f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Deleting offline snapshot a2565fb1-ee07-43e9-9bfb-0102070cf322 of volume 7297f787-e569-42f5-97de-bacb9e936cec {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 15:58:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-4d5290fa-6092-4544-82d6-e1b9fe8acc7f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] snapshot_file for this snap is: volume-7297f787-e569-42f5-97de-bacb9e936cec.a2565fb1-ee07-43e9-9bfb-0102070cf322 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 15:58:16 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d42886-b36e-4539-a4f1-0616c9302793]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4d5290fa-6092-4544-82d6-e1b9fe8acc7f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.a2565fb1-ee07-43e9-9bfb-0102070cf322 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:16 devstack sudo[99306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.a2565fb1-ee07-43e9-9bfb-0102070cf322
Sep 04 15:58:16 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:17 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4d5290fa-6092-4544-82d6-e1b9fe8acc7f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.a2565fb1-ee07-43e9-9bfb-0102070cf322" returned: 0 in 0.975s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-4d5290fa-6092-4544-82d6-e1b9fe8acc7f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7297f787-e569-42f5-97de-bacb9e936cec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:58:17 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b731e7-1c94-4053-ad8b-74ddda9a4589]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4d5290fa-6092-4544-82d6-e1b9fe8acc7f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:17 devstack sudo[99318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec
Sep 04 15:58:17 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:18 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4d5290fa-6092-4544-82d6-e1b9fe8acc7f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec" returned: 0 in 1.308s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4d5290fa-6092-4544-82d6-e1b9fe8acc7f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.a2565fb1-ee07-43e9-9bfb-0102070cf322 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:18 devstack sudo[99323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.a2565fb1-ee07-43e9-9bfb-0102070cf322
Sep 04 15:58:18 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:19 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4d5290fa-6092-4544-82d6-e1b9fe8acc7f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.a2565fb1-ee07-43e9-9bfb-0102070cf322" returned: 0 in 1.137s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4d5290fa-6092-4544-82d6-e1b9fe8acc7f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.a2565fb1-ee07-43e9-9bfb-0102070cf322 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:19 devstack sudo[99336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.a2565fb1-ee07-43e9-9bfb-0102070cf322
Sep 04 15:58:19 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:20 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4d5290fa-6092-4544-82d6-e1b9fe8acc7f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec.a2565fb1-ee07-43e9-9bfb-0102070cf322" returned: 0 in 0.718s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4d5290fa-6092-4544-82d6-e1b9fe8acc7f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Lock "cinder-quobyte-a2565fb1-ee07-43e9-9bfb-0102070cf322" released by "_delete_snapshot" :: held 4.484s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4d5290fa-6092-4544-82d6-e1b9fe8acc7f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Lock "cinder-quobyte-7297f787-e569-42f5-97de-bacb9e936cec" released by "delete_snapshot" :: held 4.521s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:20 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-4d5290fa-6092-4544-82d6-e1b9fe8acc7f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Created reservations ['04f0677f-c167-46e6-83a4-7bbc2b96f6c8', '7c8918c6-2139-423a-910e-71162948840b', 'da59972a-839c-4e0d-a90f-03527f580cce', 'fdaeb358-4eef-4d0c-9d98-a4cc88e8e484'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:58:21 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-4d5290fa-6092-4544-82d6-e1b9fe8acc7f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Delete snapshot completed successfully.
Sep 04 15:58:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4d5290fa-6092-4544-82d6-e1b9fe8acc7f tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Lock "cinder-a2565fb1-ee07-43e9-9bfb-0102070cf322-delete_snapshot" released by "delete_snapshot" :: held 4.994s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:21 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-80f5080a-11f2-441f-9afa-62fea2322a58" returned: 0 in 5.964s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:21 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37, size 1024.00 MB, duration 5.97 sec, destination /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-80f5080a-11f2-441f-9afa-62fea2322a58 {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 15:58:21 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Converted 1024.00 MB image at 171.66 MB/s
Sep 04 15:58:21 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-80f5080a-11f2-441f-9afa-62fea2322a58 is being set with open permissions: ugo+rw
Sep 04 15:58:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-80f5080a-11f2-441f-9afa-62fea2322a58 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:21 devstack sudo[99341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-80f5080a-11f2-441f-9afa-62fea2322a58
Sep 04 15:58:21 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bea58491-3377-485f-b0fc-46bec27dc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Acquiring lock "cinder-7297f787-e569-42f5-97de-bacb9e936cec-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bea58491-3377-485f-b0fc-46bec27dc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Lock "cinder-7297f787-e569-42f5-97de-bacb9e936cec-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bea58491-3377-485f-b0fc-46bec27dc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Acquiring lock "cinder-quobyte-7297f787-e569-42f5-97de-bacb9e936cec" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:22 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-80f5080a-11f2-441f-9afa-62fea2322a58" returned: 0 in 0.321s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Lock "cinder-quobyte-80f5080a-11f2-441f-9afa-62fea2322a58" released by "_copy_volume_from_snapshot" :: held 7.299s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bea58491-3377-485f-b0fc-46bec27dc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Lock "cinder-quobyte-7297f787-e569-42f5-97de-bacb9e936cec" acquired by "delete_volume" :: waited 0.029s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c29cdc6-47f3-4c4d-9229-cbb79f7463a7]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bea58491-3377-485f-b0fc-46bec27dc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Lock "cinder-quobyte-09c46b11-c85c-4042-a1a1-9920b6ef78ef-80f5080a-11f2-441f-9afa-62fea2322a58" released by "_create_volume_from_snapshot" :: held 7.456s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.484s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3dff511-368c-47d2-b9c8-9b0ce2115832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80f5080a-11f2-441f-9afa-62fea2322a58', 'volume_size': 1, 'snapshot_id': '09c46b11-c85c-4042-a1a1-9920b6ef78ef'}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a87354d0-77eb-4b3e-93a0-0ae4c006048d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:22 devstack sudo[99344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec
Sep 04 15:58:22 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:22 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Volume volume-80f5080a-11f2-441f-9afa-62fea2322a58 (80f5080a-11f2-441f-9afa-62fea2322a58): created successfully
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a87354d0-77eb-4b3e-93a0-0ae4c006048d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Flow 'volume_create_manager' (f545bd03-ab27-4ee3-8a85-934f83323058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:22 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-7b439a4c-e00d-4694-b4ec-d19d98a43c0f tempest-VolumeDependencyTests-1800919807 None] Created volume successfully.
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:58:22 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Flow 'volume_create_manager' (0c156226-61fd-4b87-a62b-1ffe5d80e600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56fa4cd6-20e7-42a8-a3d8-5b28a591a47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4d05c4a3-69b5-4a24-896c-172f024632ae tempest-VolumeDependencyTests-1800919807 None] Acquiring lock "cinder-09c46b11-c85c-4042-a1a1-9920b6ef78ef-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bea58491-3377-485f-b0fc-46bec27dc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec" returned: 0 in 0.535s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bea58491-3377-485f-b0fc-46bec27dc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56fa4cd6-20e7-42a8-a3d8-5b28a591a47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-381134969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3fe9c90d4f463aa3cc11b1d682e9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:23Z,use_quota=True,user_id='13b916091a2945d1a911368d04fcb36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d04b3db-4a43-4202-92fe-c7b22b95e5c0),volume_type_id=4d04b3db-4a43-4202-92fe-c7b22b95e5c0)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:22 devstack sudo[99349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db610e35-8e55-4cf8-af05-3515a26217e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:22 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db610e35-8e55-4cf8-af05-3515a26217e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0093364f-0cfa-4ff4-a500-e449613f239a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0093364f-0cfa-4ff4-a500-e449613f239a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83', 'volume_name': 'volume-edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e72c21ec-bc48-48a8-be1e-5a406a4b0708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e72c21ec-bc48-48a8-be1e-5a406a4b0708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a028c8e8-b9e5-4ae5-8298-2536507aaa10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:22 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Volume edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83', 'volume_size': 1}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-381134969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3fe9c90d4f463aa3cc11b1d682e9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:23Z,use_quota=True,user_id='13b916091a2945d1a911368d04fcb36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d04b3db-4a43-4202-92fe-c7b22b95e5c0),volume_type_id=4d04b3db-4a43-4202-92fe-c7b22b95e5c0)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Creating volume edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:58:22 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4d05c4a3-69b5-4a24-896c-172f024632ae tempest-VolumeDependencyTests-1800919807 None] Lock "cinder-09c46b11-c85c-4042-a1a1-9920b6ef78ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.111s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4d05c4a3-69b5-4a24-896c-172f024632ae tempest-VolumeDependencyTests-1800919807 None] Acquiring lock "cinder-quobyte-38bd76bb-82df-4883-ac23-8659578aab37" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4d05c4a3-69b5-4a24-896c-172f024632ae tempest-VolumeDependencyTests-1800919807 None] Lock "cinder-quobyte-38bd76bb-82df-4883-ac23-8659578aab37" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4d05c4a3-69b5-4a24-896c-172f024632ae tempest-VolumeDependencyTests-1800919807 None] Acquiring lock "cinder-quobyte-09c46b11-c85c-4042-a1a1-9920b6ef78ef" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:22 devstack sudo[99351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83 1073741824
Sep 04 15:58:22 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4d05c4a3-69b5-4a24-896c-172f024632ae tempest-VolumeDependencyTests-1800919807 None] Lock "cinder-quobyte-09c46b11-c85c-4042-a1a1-9920b6ef78ef" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-4d05c4a3-69b5-4a24-896c-172f024632ae tempest-VolumeDependencyTests-1800919807 None] Deleting offline snapshot 09c46b11-c85c-4042-a1a1-9920b6ef78ef of volume 38bd76bb-82df-4883-ac23-8659578aab37 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-4d05c4a3-69b5-4a24-896c-172f024632ae tempest-VolumeDependencyTests-1800919807 None] snapshot_file for this snap is: volume-38bd76bb-82df-4883-ac23-8659578aab37.09c46b11-c85c-4042-a1a1-9920b6ef78ef {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0530965-540c-426b-852c-47b6d0ce4113]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4d05c4a3-69b5-4a24-896c-172f024632ae tempest-VolumeDependencyTests-1800919807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.09c46b11-c85c-4042-a1a1-9920b6ef78ef {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:23 devstack sudo[99353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.09c46b11-c85c-4042-a1a1-9920b6ef78ef
Sep 04 15:58:23 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:23 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bea58491-3377-485f-b0fc-46bec27dc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7297f787-e569-42f5-97de-bacb9e936cec" returned: 0 in 0.336s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bea58491-3377-485f-b0fc-46bec27dc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Lock "cinder-quobyte-7297f787-e569-42f5-97de-bacb9e936cec" released by "delete_volume" :: held 0.960s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:23 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-bea58491-3377-485f-b0fc-46bec27dc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Created reservations ['6698dba0-eefe-4150-8da3-e1e8f2fdc310', '6b9342ca-b301-485a-a468-506ce8318b64', '17a865bd-42e8-40d4-8661-48a0cda23280', 'd60afb48-3b0c-4e5e-a45b-079e1d5e50c0'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:58:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bea58491-3377-485f-b0fc-46bec27dc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bea58491-3377-485f-b0fc-46bec27dc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bea58491-3377-485f-b0fc-46bec27dc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bea58491-3377-485f-b0fc-46bec27dc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bea58491-3377-485f-b0fc-46bec27dc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bea58491-3377-485f-b0fc-46bec27dc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:23 devstack sudo[99363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:58:23 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:23 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4d05c4a3-69b5-4a24-896c-172f024632ae tempest-VolumeDependencyTests-1800919807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.09c46b11-c85c-4042-a1a1-9920b6ef78ef" returned: 0 in 0.488s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-4d05c4a3-69b5-4a24-896c-172f024632ae tempest-VolumeDependencyTests-1800919807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38bd76bb-82df-4883-ac23-8659578aab37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:58:23 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccbe2d6-f973-446d-94f4-ea11b5dc087f]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4d05c4a3-69b5-4a24-896c-172f024632ae tempest-VolumeDependencyTests-1800919807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:23 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83 1073741824" returned: 0 in 0.689s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:23 devstack sudo[99366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83
Sep 04 15:58:23 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:23 devstack sudo[99365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37
Sep 04 15:58:23 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:23 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bea58491-3377-485f-b0fc-46bec27dc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.337s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:23 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-bea58491-3377-485f-b0fc-46bec27dc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:58:23 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-bea58491-3377-485f-b0fc-46bec27dc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Deleted volume successfully.
Sep 04 15:58:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bea58491-3377-485f-b0fc-46bec27dc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-327727663 None] Lock "cinder-7297f787-e569-42f5-97de-bacb9e936cec-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:23 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83" returned: 0 in 0.283s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:58:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:23 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a028c8e8-b9e5-4ae5-8298-2536507aaa10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:23 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c026d9c-d76f-4947-8047-7025ea69bbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:23 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Volume volume-edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83 (edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83): created successfully
Sep 04 15:58:23 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c026d9c-d76f-4947-8047-7025ea69bbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:23 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Flow 'volume_create_manager' (0c156226-61fd-4b87-a62b-1ffe5d80e600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:23 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-de068549-9fe2-4867-a307-5c7822d4cfeb tempest-VolumeTypesAccessTest-948776126 None] Created volume successfully.
Sep 04 15:58:24 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4d05c4a3-69b5-4a24-896c-172f024632ae tempest-VolumeDependencyTests-1800919807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37" returned: 0 in 0.647s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4d05c4a3-69b5-4a24-896c-172f024632ae tempest-VolumeDependencyTests-1800919807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.09c46b11-c85c-4042-a1a1-9920b6ef78ef {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:24 devstack sudo[99375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.09c46b11-c85c-4042-a1a1-9920b6ef78ef
Sep 04 15:58:24 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:24 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4d05c4a3-69b5-4a24-896c-172f024632ae tempest-VolumeDependencyTests-1800919807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.09c46b11-c85c-4042-a1a1-9920b6ef78ef" returned: 0 in 0.387s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4d05c4a3-69b5-4a24-896c-172f024632ae tempest-VolumeDependencyTests-1800919807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.09c46b11-c85c-4042-a1a1-9920b6ef78ef {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:24 devstack sudo[99380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.09c46b11-c85c-4042-a1a1-9920b6ef78ef
Sep 04 15:58:24 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f3452a5f-7b91-49d0-91b4-2e6c1e764e57 tempest-VolumeTypesAccessTest-948776126 None] Acquiring lock "cinder-edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f3452a5f-7b91-49d0-91b4-2e6c1e764e57 tempest-VolumeTypesAccessTest-948776126 None] Lock "cinder-edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f3452a5f-7b91-49d0-91b4-2e6c1e764e57 tempest-VolumeTypesAccessTest-948776126 None] Acquiring lock "cinder-quobyte-edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:24 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4d05c4a3-69b5-4a24-896c-172f024632ae tempest-VolumeDependencyTests-1800919807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37.09c46b11-c85c-4042-a1a1-9920b6ef78ef" returned: 0 in 0.406s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f3452a5f-7b91-49d0-91b4-2e6c1e764e57 tempest-VolumeTypesAccessTest-948776126 None] Lock "cinder-quobyte-edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83" acquired by "delete_volume" :: waited 0.034s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:24 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c12a0d3-2aa9-40af-89c1-cac91112138c]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f3452a5f-7b91-49d0-91b4-2e6c1e764e57 tempest-VolumeTypesAccessTest-948776126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4d05c4a3-69b5-4a24-896c-172f024632ae tempest-VolumeDependencyTests-1800919807 None] Lock "cinder-quobyte-09c46b11-c85c-4042-a1a1-9920b6ef78ef" released by "_delete_snapshot" :: held 2.107s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4d05c4a3-69b5-4a24-896c-172f024632ae tempest-VolumeDependencyTests-1800919807 None] Lock "cinder-quobyte-38bd76bb-82df-4883-ac23-8659578aab37" released by "delete_snapshot" :: held 2.145s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:25 devstack sudo[99383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83
Sep 04 15:58:25 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:25 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-4d05c4a3-69b5-4a24-896c-172f024632ae tempest-VolumeDependencyTests-1800919807 None] Created reservations ['d09c54ca-b9c6-49e4-899b-d389be308dff', '16192f9b-cde0-4d96-ab0b-be1db8e801a3', '61590949-b0fd-4036-9495-e24bfa54c0e4', '6a20ad00-81a3-4897-b1d2-110a399d78bd'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:58:25 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-4d05c4a3-69b5-4a24-896c-172f024632ae tempest-VolumeDependencyTests-1800919807 None] Delete snapshot completed successfully.
Sep 04 15:58:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4d05c4a3-69b5-4a24-896c-172f024632ae tempest-VolumeDependencyTests-1800919807 None] Lock "cinder-09c46b11-c85c-4042-a1a1-9920b6ef78ef-delete_snapshot" released by "delete_snapshot" :: held 2.399s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:25 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f3452a5f-7b91-49d0-91b4-2e6c1e764e57 tempest-VolumeTypesAccessTest-948776126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83" returned: 0 in 0.463s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f3452a5f-7b91-49d0-91b4-2e6c1e764e57 tempest-VolumeTypesAccessTest-948776126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:25 devstack sudo[99389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83
Sep 04 15:58:25 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:25 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f3452a5f-7b91-49d0-91b4-2e6c1e764e57 tempest-VolumeTypesAccessTest-948776126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83" returned: 0 in 0.292s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f3452a5f-7b91-49d0-91b4-2e6c1e764e57 tempest-VolumeTypesAccessTest-948776126 None] Lock "cinder-quobyte-edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83" released by "delete_volume" :: held 0.838s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:25 devstack cinder-volume[87504]: WARNING cinder.quota [None req-f3452a5f-7b91-49d0-91b4-2e6c1e764e57 tempest-VolumeTypesAccessTest-948776126 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2054785091 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2054785091, it is now deprecated. Please use the default quota class for default quota.
Sep 04 15:58:25 devstack cinder-volume[87504]: WARNING cinder.quota [None req-f3452a5f-7b91-49d0-91b4-2e6c1e764e57 tempest-VolumeTypesAccessTest-948776126 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2054785091 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2054785091, it is now deprecated. Please use the default quota class for default quota.
Sep 04 15:58:25 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-f3452a5f-7b91-49d0-91b4-2e6c1e764e57 tempest-VolumeTypesAccessTest-948776126 None] Created reservations ['3bde4282-942d-4305-8273-84a668339d2d', '9a2be94c-5a75-43a4-bf80-bbfe5eed0c72', '9bce8413-ee5c-4f1c-954d-57b0930b317a', '8dd691ba-e4de-47cc-8659-a6fabba4ae69'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:58:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f3452a5f-7b91-49d0-91b4-2e6c1e764e57 tempest-VolumeTypesAccessTest-948776126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f3452a5f-7b91-49d0-91b4-2e6c1e764e57 tempest-VolumeTypesAccessTest-948776126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:25 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f3452a5f-7b91-49d0-91b4-2e6c1e764e57 tempest-VolumeTypesAccessTest-948776126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:25 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f3452a5f-7b91-49d0-91b4-2e6c1e764e57 tempest-VolumeTypesAccessTest-948776126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f3452a5f-7b91-49d0-91b4-2e6c1e764e57 tempest-VolumeTypesAccessTest-948776126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f3452a5f-7b91-49d0-91b4-2e6c1e764e57 tempest-VolumeTypesAccessTest-948776126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:25 devstack sudo[99392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:58:25 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:26 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8333ca1e-d088-4960-8628-d2e5e37bacdd tempest-VolumeDependencyTests-1800919807 None] Acquiring lock "cinder-38bd76bb-82df-4883-ac23-8659578aab37-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:26 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8333ca1e-d088-4960-8628-d2e5e37bacdd tempest-VolumeDependencyTests-1800919807 None] Lock "cinder-38bd76bb-82df-4883-ac23-8659578aab37-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:26 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8333ca1e-d088-4960-8628-d2e5e37bacdd tempest-VolumeDependencyTests-1800919807 None] Acquiring lock "cinder-quobyte-38bd76bb-82df-4883-ac23-8659578aab37" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:26 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8333ca1e-d088-4960-8628-d2e5e37bacdd tempest-VolumeDependencyTests-1800919807 None] Lock "cinder-quobyte-38bd76bb-82df-4883-ac23-8659578aab37" acquired by "delete_volume" :: waited 0.016s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:26 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60674df-c460-45c9-a4fc-8a284d87b560]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8333ca1e-d088-4960-8628-d2e5e37bacdd tempest-VolumeDependencyTests-1800919807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:26 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f3452a5f-7b91-49d0-91b4-2e6c1e764e57 tempest-VolumeTypesAccessTest-948776126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.497s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:26 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-f3452a5f-7b91-49d0-91b4-2e6c1e764e57 tempest-VolumeTypesAccessTest-948776126 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:58:26 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f3452a5f-7b91-49d0-91b4-2e6c1e764e57 tempest-VolumeTypesAccessTest-948776126 None] Deleted volume successfully.
Sep 04 15:58:26 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f3452a5f-7b91-49d0-91b4-2e6c1e764e57 tempest-VolumeTypesAccessTest-948776126 None] Lock "cinder-edea34e4-8dd1-4f38-b3b7-3e8d1b7ecd83-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:26 devstack sudo[99395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37
Sep 04 15:58:26 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:26 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8333ca1e-d088-4960-8628-d2e5e37bacdd tempest-VolumeDependencyTests-1800919807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37" returned: 0 in 0.652s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8333ca1e-d088-4960-8628-d2e5e37bacdd tempest-VolumeDependencyTests-1800919807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:26 devstack sudo[99400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37
Sep 04 15:58:26 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:27 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8333ca1e-d088-4960-8628-d2e5e37bacdd tempest-VolumeDependencyTests-1800919807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-38bd76bb-82df-4883-ac23-8659578aab37" returned: 0 in 0.335s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:27 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8333ca1e-d088-4960-8628-d2e5e37bacdd tempest-VolumeDependencyTests-1800919807 None] Lock "cinder-quobyte-38bd76bb-82df-4883-ac23-8659578aab37" released by "delete_volume" :: held 1.099s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:27 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-8333ca1e-d088-4960-8628-d2e5e37bacdd tempest-VolumeDependencyTests-1800919807 None] Created reservations ['fb5db3d7-91b6-4e6a-a449-c2b14c551056', 'f298abdb-fe7a-4712-8233-4c59bd3fe800', '855918df-7e8d-441b-a6fa-80baeb4d823d', '155542d5-d21f-4540-a6e1-cd1f155a538d'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:58:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-8333ca1e-d088-4960-8628-d2e5e37bacdd tempest-VolumeDependencyTests-1800919807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-8333ca1e-d088-4960-8628-d2e5e37bacdd tempest-VolumeDependencyTests-1800919807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-8333ca1e-d088-4960-8628-d2e5e37bacdd tempest-VolumeDependencyTests-1800919807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-8333ca1e-d088-4960-8628-d2e5e37bacdd tempest-VolumeDependencyTests-1800919807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-8333ca1e-d088-4960-8628-d2e5e37bacdd tempest-VolumeDependencyTests-1800919807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8333ca1e-d088-4960-8628-d2e5e37bacdd tempest-VolumeDependencyTests-1800919807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:27 devstack sudo[99403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:58:27 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:27 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8333ca1e-d088-4960-8628-d2e5e37bacdd tempest-VolumeDependencyTests-1800919807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.333s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:27 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-8333ca1e-d088-4960-8628-d2e5e37bacdd tempest-VolumeDependencyTests-1800919807 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:58:27 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-8333ca1e-d088-4960-8628-d2e5e37bacdd tempest-VolumeDependencyTests-1800919807 None] Deleted volume successfully.
Sep 04 15:58:27 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8333ca1e-d088-4960-8628-d2e5e37bacdd tempest-VolumeDependencyTests-1800919807 None] Lock "cinder-38bd76bb-82df-4883-ac23-8659578aab37-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Flow 'volume_create_manager' (3f229a69-e4bc-4307-ac21-7c3a2c89a83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7abace2-1d81-4111-a629-0dc8008e2d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7abace2-1d81-4111-a629-0dc8008e2d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-26180622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb44382-9d7c-4876-8d07-2fb07ed490ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a7f9e6404314a50af699cb79d79e676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:28Z,use_quota=True,user_id='32f390736f114e0c942690ded0dff859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc39d9a3-6a1a-4d50-a903-ed21552e131c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc39d9a3-6a1a-4d50-a903-ed21552e131c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7651287c-eaa9-462c-ab8c-169d3f3ff74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7651287c-eaa9-462c-ab8c-169d3f3ff74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efb44382-9d7c-4876-8d07-2fb07ed490ae', 'volume_name': 'volume-efb44382-9d7c-4876-8d07-2fb07ed490ae', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b360e565-0b68-4773-a104-47abb6af8a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b360e565-0b68-4773-a104-47abb6af8a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7daa7096-60eb-488d-b479-7e81f2ad7e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:28 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Volume efb44382-9d7c-4876-8d07-2fb07ed490ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efb44382-9d7c-4876-8d07-2fb07ed490ae', 'volume_size': 1}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-26180622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb44382-9d7c-4876-8d07-2fb07ed490ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a7f9e6404314a50af699cb79d79e676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:28Z,use_quota=True,user_id='32f390736f114e0c942690ded0dff859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Creating volume efb44382-9d7c-4876-8d07-2fb07ed490ae {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:58:28 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:28 devstack sudo[99406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae 1073741824
Sep 04 15:58:28 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1adbfdf7-43b8-4871-9919-174569eed5d5 tempest-VolumeDependencyTests-1800919807 None] Acquiring lock "cinder-80f5080a-11f2-441f-9afa-62fea2322a58-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1adbfdf7-43b8-4871-9919-174569eed5d5 tempest-VolumeDependencyTests-1800919807 None] Lock "cinder-80f5080a-11f2-441f-9afa-62fea2322a58-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1adbfdf7-43b8-4871-9919-174569eed5d5 tempest-VolumeDependencyTests-1800919807 None] Acquiring lock "cinder-quobyte-80f5080a-11f2-441f-9afa-62fea2322a58" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1adbfdf7-43b8-4871-9919-174569eed5d5 tempest-VolumeDependencyTests-1800919807 None] Lock "cinder-quobyte-80f5080a-11f2-441f-9afa-62fea2322a58" acquired by "delete_volume" :: waited 0.035s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4396e585-031a-4700-8ae0-13ec33953217]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1adbfdf7-43b8-4871-9919-174569eed5d5 tempest-VolumeDependencyTests-1800919807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-80f5080a-11f2-441f-9afa-62fea2322a58 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:28 devstack sudo[99410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-80f5080a-11f2-441f-9afa-62fea2322a58
Sep 04 15:58:28 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:28 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae 1073741824" returned: 0 in 0.637s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:28 devstack sudo[99415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae
Sep 04 15:58:28 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:28 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1adbfdf7-43b8-4871-9919-174569eed5d5 tempest-VolumeDependencyTests-1800919807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-80f5080a-11f2-441f-9afa-62fea2322a58" returned: 0 in 0.480s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1adbfdf7-43b8-4871-9919-174569eed5d5 tempest-VolumeDependencyTests-1800919807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-80f5080a-11f2-441f-9afa-62fea2322a58 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:29 devstack sudo[99419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-80f5080a-11f2-441f-9afa-62fea2322a58
Sep 04 15:58:29 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:29 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae" returned: 0 in 0.302s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:29 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:58:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7daa7096-60eb-488d-b479-7e81f2ad7e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efb44382-9d7c-4876-8d07-2fb07ed490ae', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (738cab46-c25f-43ac-90b8-9124520cd0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:29 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Volume volume-efb44382-9d7c-4876-8d07-2fb07ed490ae (efb44382-9d7c-4876-8d07-2fb07ed490ae): created successfully
Sep 04 15:58:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (738cab46-c25f-43ac-90b8-9124520cd0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Flow 'volume_create_manager' (3f229a69-e4bc-4307-ac21-7c3a2c89a83e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:29 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e7ce6fb7-b7ea-4285-b7d6-1770aa03ca0d tempest-VolumesSnapshotTestJSON-1945023076 None] Created volume successfully.
Sep 04 15:58:29 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1adbfdf7-43b8-4871-9919-174569eed5d5 tempest-VolumeDependencyTests-1800919807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-80f5080a-11f2-441f-9afa-62fea2322a58" returned: 0 in 0.327s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:29 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1adbfdf7-43b8-4871-9919-174569eed5d5 tempest-VolumeDependencyTests-1800919807 None] Lock "cinder-quobyte-80f5080a-11f2-441f-9afa-62fea2322a58" released by "delete_volume" :: held 0.867s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:29 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-1adbfdf7-43b8-4871-9919-174569eed5d5 tempest-VolumeDependencyTests-1800919807 None] Created reservations ['75c0ca68-61ca-4a02-a7d7-7aec38c20a7b', '254b9d9f-76b7-4584-bba5-747a66540d01', '498db793-c9e1-4e14-8b47-b2e2d2533427', 'd2b9f930-4512-4752-b735-850995359506'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:58:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1adbfdf7-43b8-4871-9919-174569eed5d5 tempest-VolumeDependencyTests-1800919807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1adbfdf7-43b8-4871-9919-174569eed5d5 tempest-VolumeDependencyTests-1800919807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:29 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1adbfdf7-43b8-4871-9919-174569eed5d5 tempest-VolumeDependencyTests-1800919807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:29 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1adbfdf7-43b8-4871-9919-174569eed5d5 tempest-VolumeDependencyTests-1800919807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1adbfdf7-43b8-4871-9919-174569eed5d5 tempest-VolumeDependencyTests-1800919807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1adbfdf7-43b8-4871-9919-174569eed5d5 tempest-VolumeDependencyTests-1800919807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:29 devstack sudo[99423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:58:29 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:29 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1adbfdf7-43b8-4871-9919-174569eed5d5 tempest-VolumeDependencyTests-1800919807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.276s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:29 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-1adbfdf7-43b8-4871-9919-174569eed5d5 tempest-VolumeDependencyTests-1800919807 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:58:29 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-1adbfdf7-43b8-4871-9919-174569eed5d5 tempest-VolumeDependencyTests-1800919807 None] Deleted volume successfully.
Sep 04 15:58:29 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1adbfdf7-43b8-4871-9919-174569eed5d5 tempest-VolumeDependencyTests-1800919807 None] Lock "cinder-80f5080a-11f2-441f-9afa-62fea2322a58-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-17fb619a-34ae-434c-96b4-dd0df6e385de tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-17fb619a-34ae-434c-96b4-dd0df6e385de tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:30 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-17fb619a-34ae-434c-96b4-dd0df6e385de tempest-VolumesSnapshotTestJSON-1945023076 None] Creating offline snapshot 406e425b-0e89-4023-a99c-5f7c28fa4240 of volume efb44382-9d7c-4876-8d07-2fb07ed490ae {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:58:30 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb972976-2dc1-425a-82ad-e796ce49d18e]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-17fb619a-34ae-434c-96b4-dd0df6e385de tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:30 devstack sudo[99426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae
Sep 04 15:58:30 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:31 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-17fb619a-34ae-434c-96b4-dd0df6e385de tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae" returned: 0 in 0.456s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-17fb619a-34ae-434c-96b4-dd0df6e385de tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.406e425b-0e89-4023-a99c-5f7c28fa4240 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:31 devstack sudo[99432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.406e425b-0e89-4023-a99c-5f7c28fa4240 1G
Sep 04 15:58:31 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:31 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-17fb619a-34ae-434c-96b4-dd0df6e385de tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.406e425b-0e89-4023-a99c-5f7c28fa4240 1G" returned: 0 in 0.656s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-17fb619a-34ae-434c-96b4-dd0df6e385de tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efb44382-9d7c-4876-8d07-2fb07ed490ae -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.406e425b-0e89-4023-a99c-5f7c28fa4240 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:31 devstack sudo[99438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efb44382-9d7c-4876-8d07-2fb07ed490ae -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.406e425b-0e89-4023-a99c-5f7c28fa4240
Sep 04 15:58:31 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:32 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-17fb619a-34ae-434c-96b4-dd0df6e385de tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efb44382-9d7c-4876-8d07-2fb07ed490ae -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.406e425b-0e89-4023-a99c-5f7c28fa4240" returned: 0 in 0.345s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:32 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-17fb619a-34ae-434c-96b4-dd0df6e385de tempest-VolumesSnapshotTestJSON-1945023076 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.406e425b-0e89-4023-a99c-5f7c28fa4240 is being set with open permissions: ugo+rw
Sep 04 15:58:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-17fb619a-34ae-434c-96b4-dd0df6e385de tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.406e425b-0e89-4023-a99c-5f7c28fa4240 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:32 devstack sudo[99443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.406e425b-0e89-4023-a99c-5f7c28fa4240
Sep 04 15:58:32 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:32 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-17fb619a-34ae-434c-96b4-dd0df6e385de tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.406e425b-0e89-4023-a99c-5f7c28fa4240" returned: 0 in 0.314s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-17fb619a-34ae-434c-96b4-dd0df6e385de tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:32 devstack sudo[99446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.info
Sep 04 15:58:32 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:32 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-17fb619a-34ae-434c-96b4-dd0df6e385de tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.info" returned: 0 in 0.386s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:32 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-17fb619a-34ae-434c-96b4-dd0df6e385de tempest-VolumesSnapshotTestJSON-1945023076 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.info is being set with open permissions: ugo+rw
Sep 04 15:58:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-17fb619a-34ae-434c-96b4-dd0df6e385de tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:32 devstack sudo[99449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.info
Sep 04 15:58:32 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:33 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-17fb619a-34ae-434c-96b4-dd0df6e385de tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.info" returned: 0 in 0.296s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-17fb619a-34ae-434c-96b4-dd0df6e385de tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.581s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:33 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-17fb619a-34ae-434c-96b4-dd0df6e385de tempest-VolumesSnapshotTestJSON-1945023076 None] Create snapshot completed successfully
Sep 04 15:58:34 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-994dd803-d2dc-4330-8e04-ba90871c79f0 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "cinder-406e425b-0e89-4023-a99c-5f7c28fa4240-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:34 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-994dd803-d2dc-4330-8e04-ba90871c79f0 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-406e425b-0e89-4023-a99c-5f7c28fa4240-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:34 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-994dd803-d2dc-4330-8e04-ba90871c79f0 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "cinder-quobyte-efb44382-9d7c-4876-8d07-2fb07ed490ae" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:34 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-994dd803-d2dc-4330-8e04-ba90871c79f0 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-efb44382-9d7c-4876-8d07-2fb07ed490ae" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:34 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-994dd803-d2dc-4330-8e04-ba90871c79f0 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "cinder-quobyte-406e425b-0e89-4023-a99c-5f7c28fa4240" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:34 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-994dd803-d2dc-4330-8e04-ba90871c79f0 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-406e425b-0e89-4023-a99c-5f7c28fa4240" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-994dd803-d2dc-4330-8e04-ba90871c79f0 tempest-VolumesSnapshotTestJSON-1945023076 None] Deleting offline snapshot 406e425b-0e89-4023-a99c-5f7c28fa4240 of volume efb44382-9d7c-4876-8d07-2fb07ed490ae {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 15:58:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-994dd803-d2dc-4330-8e04-ba90871c79f0 tempest-VolumesSnapshotTestJSON-1945023076 None] snapshot_file for this snap is: volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.406e425b-0e89-4023-a99c-5f7c28fa4240 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 15:58:34 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e772e95e-7f2f-492f-90fb-73755a8cb4cf]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-994dd803-d2dc-4330-8e04-ba90871c79f0 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.406e425b-0e89-4023-a99c-5f7c28fa4240 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:34 devstack sudo[99453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.406e425b-0e89-4023-a99c-5f7c28fa4240
Sep 04 15:58:34 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:34 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-994dd803-d2dc-4330-8e04-ba90871c79f0 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.406e425b-0e89-4023-a99c-5f7c28fa4240" returned: 0 in 0.497s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-994dd803-d2dc-4330-8e04-ba90871c79f0 tempest-VolumesSnapshotTestJSON-1945023076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efb44382-9d7c-4876-8d07-2fb07ed490ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:58:34 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fb2303-b2f5-46d2-be35-9e2257e204f1]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-994dd803-d2dc-4330-8e04-ba90871c79f0 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:34 devstack sudo[99458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae
Sep 04 15:58:34 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:35 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-994dd803-d2dc-4330-8e04-ba90871c79f0 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae" returned: 0 in 0.474s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-994dd803-d2dc-4330-8e04-ba90871c79f0 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.406e425b-0e89-4023-a99c-5f7c28fa4240 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:35 devstack sudo[99468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.406e425b-0e89-4023-a99c-5f7c28fa4240
Sep 04 15:58:35 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:35 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-994dd803-d2dc-4330-8e04-ba90871c79f0 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.406e425b-0e89-4023-a99c-5f7c28fa4240" returned: 0 in 0.453s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-994dd803-d2dc-4330-8e04-ba90871c79f0 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.406e425b-0e89-4023-a99c-5f7c28fa4240 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:35 devstack sudo[99474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.406e425b-0e89-4023-a99c-5f7c28fa4240
Sep 04 15:58:35 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:35 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-994dd803-d2dc-4330-8e04-ba90871c79f0 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae.406e425b-0e89-4023-a99c-5f7c28fa4240" returned: 0 in 0.358s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:36 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-994dd803-d2dc-4330-8e04-ba90871c79f0 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-406e425b-0e89-4023-a99c-5f7c28fa4240" released by "_delete_snapshot" :: held 1.953s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:36 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-994dd803-d2dc-4330-8e04-ba90871c79f0 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-efb44382-9d7c-4876-8d07-2fb07ed490ae" released by "delete_snapshot" :: held 1.988s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:36 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-994dd803-d2dc-4330-8e04-ba90871c79f0 tempest-VolumesSnapshotTestJSON-1945023076 None] Created reservations ['54c34a12-4896-4a6b-b3fc-67027cf683b3', '52beef62-0e0b-4cab-806e-61f077d11a61', '36c46992-7763-4d43-bfd1-2b800e4f22b7', '1ed94971-a4a2-4b07-bef3-cb7c918f3e1b'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:58:36 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-994dd803-d2dc-4330-8e04-ba90871c79f0 tempest-VolumesSnapshotTestJSON-1945023076 None] Delete snapshot completed successfully.
Sep 04 15:58:36 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-994dd803-d2dc-4330-8e04-ba90871c79f0 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-406e425b-0e89-4023-a99c-5f7c28fa4240-delete_snapshot" released by "delete_snapshot" :: held 2.248s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:37 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:58:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Flow 'volume_create_manager' (903160f0-4cd2-467f-8a86-bcc0a79c9385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63d2b2b9-282c-4d24-8f50-ed5067fbfa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63d2b2b9-282c-4d24-8f50-ed5067fbfa7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2633f930-600b-46e7-bf4d-8f0dee10a675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='296776db906a4adbbfd08656ef23b5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:38Z,use_quota=True,user_id='f145edbc5f9b484b8008327566095340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ebf566-6017-4e84-a40e-af9c417514f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ebf566-6017-4e84-a40e-af9c417514f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ff34b7-a50c-416b-ab0e-54dc7ac73510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:37 devstack cinder-volume[87504]: DEBUG cinder.image.glance [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Creating Keystone auth plugin from conf {{(pid=87504) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Flow 'volume_create_manager' (ea2dd374-47af-4376-8cba-a5a6eb7f1be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce05a9f0-b564-4e37-81bb-d5a6e775500c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce05a9f0-b564-4e37-81bb-d5a6e775500c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1596335099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a7f9e6404314a50af699cb79d79e676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:38Z,use_quota=True,user_id='32f390736f114e0c942690ded0dff859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b415a202-619d-4f51-b157-f734642ed68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b415a202-619d-4f51-b157-f734642ed68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef33108e-5e74-4be6-93fd-33100c1a5efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef33108e-5e74-4be6-93fd-33100c1a5efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d', 'volume_name': 'volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6dda68-1006-48a6-8474-8496e5c81a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6dda68-1006-48a6-8474-8496e5c81a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0072aacc-82d9-47e9-85a7-4dd2228f04bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:38 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Volume ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d', 'volume_size': 1}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1596335099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a7f9e6404314a50af699cb79d79e676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:38Z,use_quota=True,user_id='32f390736f114e0c942690ded0dff859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Creating volume ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:58:38 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:38 devstack sudo[99477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d 1073741824
Sep 04 15:58:38 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ff34b7-a50c-416b-ab0e-54dc7ac73510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2633f930-600b-46e7-bf4d-8f0dee10a675', 'volume_name': 'volume-2633f930-600b-46e7-bf4d-8f0dee10a675', 'volume_size': 1, 'image_id': 'cbf329f3-fb51-44d8-b04a-6a5a1efbcf89', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cbf329f3-fb51-44d8-b04a-6a5a1efbcf89', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9befe0a4c50958d346894e9e93ff488f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '296776db906a4adbbfd08656ef23b5bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f7b9bf1ea95feebb8149300338dd249ecf7bcc4faef3875bb979d238e208f9b379f01f01045fef0e6c679cd40cf37d64ecda04df3132c7118b9ee0fc035be6a', 'id': 'cbf329f3-fb51-44d8-b04a-6a5a1efbcf89', 'created_at': datetime.datetime(2026, 9, 4, 13, 58, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 58, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cbf329f3-fb51-44d8-b04a-6a5a1efbcf89/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1ad667320>}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48413014-cf43-4463-ac7c-37ba697329f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48413014-cf43-4463-ac7c-37ba697329f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f9f337-74ce-47d0-9b52-e2bb33575c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:38 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Volume 2633f930-600b-46e7-bf4d-8f0dee10a675: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2633f930-600b-46e7-bf4d-8f0dee10a675', 'volume_size': 1, 'image_id': 'cbf329f3-fb51-44d8-b04a-6a5a1efbcf89', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cbf329f3-fb51-44d8-b04a-6a5a1efbcf89', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9befe0a4c50958d346894e9e93ff488f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '296776db906a4adbbfd08656ef23b5bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f7b9bf1ea95feebb8149300338dd249ecf7bcc4faef3875bb979d238e208f9b379f01f01045fef0e6c679cd40cf37d64ecda04df3132c7118b9ee0fc035be6a', 'id': 'cbf329f3-fb51-44d8-b04a-6a5a1efbcf89', 'created_at': datetime.datetime(2026, 9, 4, 13, 58, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 58, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cbf329f3-fb51-44d8-b04a-6a5a1efbcf89/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1ad667320>}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Trying to clone 2633f930-600b-46e7-bf4d-8f0dee10a675 from image cbf329f3-fb51-44d8-b04a-6a5a1efbcf89 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cbf329f3-fb51-44d8-b04a-6a5a1efbcf89', 'metadata': {}}]). {{(pid=87504) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 04 15:58:38 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d 1073741824" returned: 0 in 0.582s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 04 15:58:38 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Image download 0.00 MB at 0.00 MB/s
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:38 devstack sudo[99483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d
Sep 04 15:58:38 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bd9e87-5e9f-4531-9421-3c4001d01113]: (4, 'raw') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:38 devstack sudo[99485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD
Sep 04 15:58:38 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:39 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d" returned: 0 in 0.332s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:39 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:58:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0072aacc-82d9-47e9-85a7-4dd2228f04bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5dd9b4e-aa6e-4a85-9dbf-aff18fd4c9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:39 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Volume volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d (ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d): created successfully
Sep 04 15:58:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5dd9b4e-aa6e-4a85-9dbf-aff18fd4c9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Flow 'volume_create_manager' (ea2dd374-47af-4376-8cba-a5a6eb7f1be8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:39 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-748b4c58-0493-4caa-98f1-1220775c0c18 tempest-VolumesSnapshotTestJSON-1945023076 None] Created volume successfully.
Sep 04 15:58:39 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD" returned: 0 in 0.447s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:39 devstack sudo[99490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD
Sep 04 15:58:39 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:39 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD" returned: 1 in 0.377s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 15:58:39 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Temporary image cbf329f3-fb51-44d8-b04a-6a5a1efbcf89 is fetched for user f145edbc5f9b484b8008327566095340. {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 04 15:58:39 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[020e0f28-d12c-48c3-94b9-18d3916d8d5c]: (4, 'raw') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:39 devstack sudo[99495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD
Sep 04 15:58:39 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:40 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:58:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Flow 'volume_create_manager' (97db4f41-c568-4013-a1b7-1451cb74753f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a83031-96a0-4ee1-9470-5ac854470a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a83031-96a0-4ee1-9470-5ac854470a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1790524318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42491d8a-f512-43d2-937f-0d149699d8c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b6fb61947a45c092dfcb008720c4fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:40Z,use_quota=True,user_id='10a29724348f4075ae4527bb5cc17b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3dc1431-dc75-435d-a85c-06968f0fa870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3dc1431-dc75-435d-a85c-06968f0fa870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7668b5a4-8e06-409f-a479-21a02780a7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:40 devstack cinder-volume[87504]: DEBUG cinder.image.glance [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Creating Keystone auth plugin from conf {{(pid=87504) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 04 15:58:40 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c1ff48c8-8b68-409c-b832-d9cd81205d89 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c1ff48c8-8b68-409c-b832-d9cd81205d89 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:40 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-c1ff48c8-8b68-409c-b832-d9cd81205d89 tempest-VolumesSnapshotTestJSON-1945023076 None] Creating offline snapshot 7e35480a-7ace-471a-a88f-febbb826207a of volume ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:58:40 devstack sudo[99499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD
Sep 04 15:58:40 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8110ca-63d2-423e-9577-1eaf0248a763]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:40 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c1ff48c8-8b68-409c-b832-d9cd81205d89 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:40 devstack sudo[99501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d
Sep 04 15:58:40 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:40 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD" returned: 1 in 0.535s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 15:58:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7668b5a4-8e06-409f-a479-21a02780a7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '42491d8a-f512-43d2-937f-0d149699d8c3', 'volume_name': 'volume-42491d8a-f512-43d2-937f-0d149699d8c3', 'volume_size': 1, 'image_id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f6dbd3908a2d48468b7f486df9705903', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9488c80e-bb64-48e5-b1fb-9998fd167822/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1a2bcc920>}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65987953-9c32-4756-b2fd-b99084de9305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65987953-9c32-4756-b2fd-b99084de9305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (828aa02e-24fe-4223-ba76-c01e1f12160b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:40 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Volume 42491d8a-f512-43d2-937f-0d149699d8c3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-42491d8a-f512-43d2-937f-0d149699d8c3', 'volume_size': 1, 'image_id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f6dbd3908a2d48468b7f486df9705903', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9488c80e-bb64-48e5-b1fb-9998fd167822/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1a2bcc920>}
Sep 04 15:58:40 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Trying to clone 42491d8a-f512-43d2-937f-0d149699d8c3 from image 9488c80e-bb64-48e5-b1fb-9998fd167822 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}]). {{(pid=87504) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 04 15:58:40 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c1ff48c8-8b68-409c-b832-d9cd81205d89 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d" returned: 0 in 0.509s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c1ff48c8-8b68-409c-b832-d9cd81205d89 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.7e35480a-7ace-471a-a88f-febbb826207a 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:40 devstack sudo[99509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.7e35480a-7ace-471a-a88f-febbb826207a 1G
Sep 04 15:58:40 devstack sudo[99509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:41 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_986q5gpudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 04 15:58:41 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Image download 20.69 MB at 20.69 MB/s
Sep 04 15:58:41 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc95778c-afec-4d5c-a750-8680f0ba57c0]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_986q5gpudevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:41 devstack sudo[99514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_986q5gpudevstack@QuobyteHD
Sep 04 15:58:41 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:41 devstack sudo[99509]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c1ff48c8-8b68-409c-b832-d9cd81205d89 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.7e35480a-7ace-471a-a88f-febbb826207a 1G" returned: 0 in 0.531s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c1ff48c8-8b68-409c-b832-d9cd81205d89 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.7e35480a-7ace-471a-a88f-febbb826207a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:41 devstack sudo[99518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.7e35480a-7ace-471a-a88f-febbb826207a
Sep 04 15:58:41 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:41 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_986q5gpudevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:41 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Temporary image 9488c80e-bb64-48e5-b1fb-9998fd167822 is fetched for user 10a29724348f4075ae4527bb5cc17b1e. {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 04 15:58:41 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f0c32c-5f26-4a41-9a18-f70d7dd67156]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_986q5gpudevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:41 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c1ff48c8-8b68-409c-b832-d9cd81205d89 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.7e35480a-7ace-471a-a88f-febbb826207a" returned: 0 in 0.366s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:41 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-c1ff48c8-8b68-409c-b832-d9cd81205d89 tempest-VolumesSnapshotTestJSON-1945023076 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.7e35480a-7ace-471a-a88f-febbb826207a is being set with open permissions: ugo+rw
Sep 04 15:58:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c1ff48c8-8b68-409c-b832-d9cd81205d89 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.7e35480a-7ace-471a-a88f-febbb826207a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:41 devstack sudo[99527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.7e35480a-7ace-471a-a88f-febbb826207a
Sep 04 15:58:41 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:41 devstack sudo[99526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_986q5gpudevstack@QuobyteHD
Sep 04 15:58:41 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:42 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c1ff48c8-8b68-409c-b832-d9cd81205d89 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.7e35480a-7ace-471a-a88f-febbb826207a" returned: 0 in 0.297s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:42 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_986q5gpudevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c1ff48c8-8b68-409c-b832-d9cd81205d89 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:42 devstack sudo[99534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.info
Sep 04 15:58:42 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:42 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c1ff48c8-8b68-409c-b832-d9cd81205d89 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.info" returned: 0 in 0.259s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:42 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-c1ff48c8-8b68-409c-b832-d9cd81205d89 tempest-VolumesSnapshotTestJSON-1945023076 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.info is being set with open permissions: ugo+rw
Sep 04 15:58:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c1ff48c8-8b68-409c-b832-d9cd81205d89 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:42 devstack sudo[99537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.info
Sep 04 15:58:42 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:42 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c1ff48c8-8b68-409c-b832-d9cd81205d89 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.info" returned: 0 in 0.247s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c1ff48c8-8b68-409c-b832-d9cd81205d89 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.337s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.966s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2633f930-600b-46e7-bf4d-8f0dee10a675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='296776db906a4adbbfd08656ef23b5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:38Z,use_quota=True,user_id='f145edbc5f9b484b8008327566095340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:58:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Creating volume 2633f930-600b-46e7-bf4d-8f0dee10a675 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:58:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:58:42 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:58:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2633f930-600b-46e7-bf4d-8f0dee10a675 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:42 devstack sudo[99540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2633f930-600b-46e7-bf4d-8f0dee10a675 1073741824
Sep 04 15:58:42 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:42 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-c1ff48c8-8b68-409c-b832-d9cd81205d89 tempest-VolumesSnapshotTestJSON-1945023076 None] Create snapshot completed successfully
Sep 04 15:58:43 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2633f930-600b-46e7-bf4d-8f0dee10a675 1073741824" returned: 0 in 0.465s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2633f930-600b-46e7-bf4d-8f0dee10a675 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:43 devstack sudo[99546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2633f930-600b-46e7-bf4d-8f0dee10a675
Sep 04 15:58:43 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:43 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2633f930-600b-46e7-bf4d-8f0dee10a675" returned: 0 in 0.249s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:58:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.313s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1790524318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42491d8a-f512-43d2-937f-0d149699d8c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b6fb61947a45c092dfcb008720c4fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:40Z,use_quota=True,user_id='10a29724348f4075ae4527bb5cc17b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:58:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Creating volume 42491d8a-f512-43d2-937f-0d149699d8c3 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:58:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:58:43 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:58:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-42491d8a-f512-43d2-937f-0d149699d8c3 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:43 devstack sudo[99549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-42491d8a-f512-43d2-937f-0d149699d8c3 1073741824
Sep 04 15:58:43 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:43 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Attempting download of cbf329f3-fb51-44d8-b04a-6a5a1efbcf89 ((None, [{'url': 'file:///opt/stack/data/glance/images/cbf329f3-fb51-44d8-b04a-6a5a1efbcf89', 'metadata': {}}])) to volume 2633f930-600b-46e7-bf4d-8f0dee10a675. {{(pid=87504) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 04 15:58:43 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0257e6b-c6bd-4b8e-bad4-ece58bcf1e50]: (4, 'raw') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_b5u33ipz {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:43 devstack sudo[99551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_b5u33ipz
Sep 04 15:58:43 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:43 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_b5u33ipz" returned: 0 in 0.392s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_b5u33ipz {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:44 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-42491d8a-f512-43d2-937f-0d149699d8c3 1073741824" returned: 0 in 0.602s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-42491d8a-f512-43d2-937f-0d149699d8c3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:44 devstack sudo[99559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_b5u33ipz
Sep 04 15:58:44 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:44 devstack sudo[99561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-42491d8a-f512-43d2-937f-0d149699d8c3
Sep 04 15:58:44 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Flow 'volume_create_manager' (8eee4c19-6ad8-4233-99b2-09a04c969d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a76786-032d-41e1-8631-aa951c2fcc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a76786-032d-41e1-8631-aa951c2fcc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1101243162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=673cf41e-492d-4a2a-ac5f-02af36267041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a7f9e6404314a50af699cb79d79e676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=7e35480a-7ace-471a-a88f-febbb826207a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:44Z,use_quota=True,user_id='32f390736f114e0c942690ded0dff859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (163f6ba4-f6eb-46cd-a3e4-ca021bf33148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (163f6ba4-f6eb-46cd-a3e4-ca021bf33148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc07464e-e2db-4947-aaf8-f2d5f0004b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc07464e-e2db-4947-aaf8-f2d5f0004b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '673cf41e-492d-4a2a-ac5f-02af36267041', 'volume_name': 'volume-673cf41e-492d-4a2a-ac5f-02af36267041', 'volume_size': 2, 'snapshot_id': '7e35480a-7ace-471a-a88f-febbb826207a'}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5587e06-c4d9-49d4-957d-3a8759c03eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5587e06-c4d9-49d4-957d-3a8759c03eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa40f61-3e3c-47a7-a361-ca335d1036cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:44 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Volume 673cf41e-492d-4a2a-ac5f-02af36267041: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-673cf41e-492d-4a2a-ac5f-02af36267041', 'volume_size': 2, 'snapshot_id': '7e35480a-7ace-471a-a88f-febbb826207a'}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:44 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_b5u33ipz" returned: 1 in 0.412s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_b5u33ipz' failed. Not Retrying. {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a527cdb6-7ec7-46dd-80b7-9f2213ef2f0d]: (4, 'raw') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:44 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-42491d8a-f512-43d2-937f-0d149699d8c3" returned: 0 in 0.337s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.090s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "cinder-quobyte-7e35480a-7ace-471a-a88f-febbb826207a-673cf41e-492d-4a2a-ac5f-02af36267041" by "_create_volume_from_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-7e35480a-7ace-471a-a88f-febbb826207a-673cf41e-492d-4a2a-ac5f-02af36267041" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Creating volume 673cf41e-492d-4a2a-ac5f-02af36267041 from snapshot 7e35480a-7ace-471a-a88f-febbb826207a {{(pid=87504) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "cinder-quobyte-673cf41e-492d-4a2a-ac5f-02af36267041" by "_copy_volume_from_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Attempting download of 9488c80e-bb64-48e5-b1fb-9998fd167822 ((None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}])) to volume 42491d8a-f512-43d2-937f-0d149699d8c3. {{(pid=87504) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-673cf41e-492d-4a2a-ac5f-02af36267041" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] snapshot: 7e35480a-7ace-471a-a88f-febbb826207a, volume: 673cf41e-492d-4a2a-ac5f-02af36267041,  {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 04 15:58:44 devstack sudo[99567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD
Sep 04 15:58:44 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad99021-e7a5-4daa-8352-9f598740e65e]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.7e35480a-7ace-471a-a88f-febbb826207a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5d5b0a-aa4f-4fbb-8c50-775d7f3d2617]: (4, 'raw') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_7dt9ihm1 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:44 devstack sudo[99569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.7e35480a-7ace-471a-a88f-febbb826207a
Sep 04 15:58:44 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:44 devstack sudo[99570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_7dt9ihm1
Sep 04 15:58:44 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:44 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:44 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:44 devstack sudo[99575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD
Sep 04 15:58:44 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_7dt9ihm1" returned: 0 in 0.394s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_7dt9ihm1 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:45 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.7e35480a-7ace-471a-a88f-febbb826207a" returned: 0 in 0.459s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:45 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:58:45 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36067a8-ca05-41b4-98f7-2983a2e061d5]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:45 devstack sudo[99583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_7dt9ihm1
Sep 04 15:58:45 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:45 devstack sudo[99584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d
Sep 04 15:58:45 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:45 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD" returned: 1 in 0.417s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 15:58:45 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] cbf329f3-fb51-44d8-b04a-6a5a1efbcf89 was raw, converting to qcow2 {{(pid=87504) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 04 15:58:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2633f930-600b-46e7-bf4d-8f0dee10a675 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:45 devstack sudo[99590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2633f930-600b-46e7-bf4d-8f0dee10a675
Sep 04 15:58:45 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:45 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_7dt9ihm1" returned: 1 in 0.400s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_7dt9ihm1' failed. Not Retrying. {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 15:58:45 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a82233-4029-4f3e-855b-6cc0765cccd4]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_986q5gpudevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:45 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d" returned: 0 in 0.486s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:45 devstack sudo[99594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_986q5gpudevstack@QuobyteHD
Sep 04 15:58:45 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 04 15:58:45 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Creating direct copy from snapshot {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 04 15:58:45 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:45 devstack cinder-volume[87504]: DEBUG cinder.utils [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Path /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-673cf41e-492d-4a2a-ac5f-02af36267041 not found in is_blk_device check {{(pid=87504) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 04 15:58:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-673cf41e-492d-4a2a-ac5f-02af36267041 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:45 devstack sudo[99602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-673cf41e-492d-4a2a-ac5f-02af36267041
Sep 04 15:58:45 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:45 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2633f930-600b-46e7-bf4d-8f0dee10a675" returned: 0 in 0.578s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:45 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cbf329f3-fb51-44d8-b04a-6a5a1efbcf89_ba1ttafpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2633f930-600b-46e7-bf4d-8f0dee10a675 {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 15:58:45 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Converted 0.00 MB image at 0.00 MB/s
Sep 04 15:58:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2633f930-600b-46e7-bf4d-8f0dee10a675 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:45 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_986q5gpudevstack@QuobyteHD" returned: 0 in 0.450s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:45 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] 9488c80e-bb64-48e5-b1fb-9998fd167822 was qcow2, converting to qcow2 {{(pid=87504) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 04 15:58:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_986q5gpudevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-42491d8a-f512-43d2-937f-0d149699d8c3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:45 devstack sudo[99610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2633f930-600b-46e7-bf4d-8f0dee10a675 1G
Sep 04 15:58:45 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:45 devstack sudo[99612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_986q5gpudevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-42491d8a-f512-43d2-937f-0d149699d8c3
Sep 04 15:58:45 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:46 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2633f930-600b-46e7-bf4d-8f0dee10a675 1G" returned: 0 in 0.621s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:46 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Downloaded image cbf329f3-fb51-44d8-b04a-6a5a1efbcf89 ((None, [{'url': 'file:///opt/stack/data/glance/images/cbf329f3-fb51-44d8-b04a-6a5a1efbcf89', 'metadata': {}}])) to volume 2633f930-600b-46e7-bf4d-8f0dee10a675 successfully. {{(pid=87504) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 04 15:58:46 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Temporary image cbf329f3-fb51-44d8-b04a-6a5a1efbcf89 for user f145edbc5f9b484b8008327566095340 is deleted. {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 04 15:58:46 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Marking volume 2633f930-600b-46e7-bf4d-8f0dee10a675 as bootable. {{(pid=87504) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 04 15:58:46 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Copying metadata from image cbf329f3-fb51-44d8-b04a-6a5a1efbcf89 to 2633f930-600b-46e7-bf4d-8f0dee10a675. {{(pid=87504) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 04 15:58:46 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Creating volume glance metadata for volume 2633f930-600b-46e7-bf4d-8f0dee10a675 backed by image cbf329f3-fb51-44d8-b04a-6a5a1efbcf89 with: {'image_id': 'cbf329f3-fb51-44d8-b04a-6a5a1efbcf89', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9befe0a4c50958d346894e9e93ff488f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87504) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 04 15:58:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f9f337-74ce-47d0-9b52-e2bb33575c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2633f930-600b-46e7-bf4d-8f0dee10a675', 'volume_size': 1, 'image_id': 'cbf329f3-fb51-44d8-b04a-6a5a1efbcf89', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cbf329f3-fb51-44d8-b04a-6a5a1efbcf89', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9befe0a4c50958d346894e9e93ff488f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '296776db906a4adbbfd08656ef23b5bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f7b9bf1ea95feebb8149300338dd249ecf7bcc4faef3875bb979d238e208f9b379f01f01045fef0e6c679cd40cf37d64ecda04df3132c7118b9ee0fc035be6a', 'id': 'cbf329f3-fb51-44d8-b04a-6a5a1efbcf89', 'created_at': datetime.datetime(2026, 9, 4, 13, 58, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 58, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cbf329f3-fb51-44d8-b04a-6a5a1efbcf89/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1ad667320>}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3139836a-d0c5-4b06-b454-e7b7a8cec44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:46 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Volume volume-2633f930-600b-46e7-bf4d-8f0dee10a675 (2633f930-600b-46e7-bf4d-8f0dee10a675): created successfully
Sep 04 15:58:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3139836a-d0c5-4b06-b454-e7b7a8cec44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Flow 'volume_create_manager' (903160f0-4cd2-467f-8a86-bcc0a79c9385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:46 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:UPDATE=166,cinder:SELECT=161,cinder:INSERT=62,cinder:DELETE=14 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:58:46 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-cfc947b1-8600-46b2-8a40-9d7b565a91cc tempest-VolumeImageDependencyTests-362996715 None] Created volume successfully.
Sep 04 15:58:46 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:INSERT=40,cinder:UPDATE=175,cinder:SELECT=142,cinder:DELETE=11 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:58:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2a5f1772-1842-4018-baeb-67bb864c6564 tempest-VolumeImageDependencyTests-362996715 None] Acquiring lock "cinder-2633f930-600b-46e7-bf4d-8f0dee10a675-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2a5f1772-1842-4018-baeb-67bb864c6564 tempest-VolumeImageDependencyTests-362996715 None] Lock "cinder-2633f930-600b-46e7-bf4d-8f0dee10a675-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2a5f1772-1842-4018-baeb-67bb864c6564 tempest-VolumeImageDependencyTests-362996715 None] Acquiring lock "cinder-quobyte-2633f930-600b-46e7-bf4d-8f0dee10a675" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:48 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2a5f1772-1842-4018-baeb-67bb864c6564 tempest-VolumeImageDependencyTests-362996715 None] Lock "cinder-quobyte-2633f930-600b-46e7-bf4d-8f0dee10a675" acquired by "delete_volume" :: waited 0.053s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:48 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6896a240-a825-44e6-93f7-2d1f701b7f91]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2a5f1772-1842-4018-baeb-67bb864c6564 tempest-VolumeImageDependencyTests-362996715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2633f930-600b-46e7-bf4d-8f0dee10a675 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:48 devstack sudo[99635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2633f930-600b-46e7-bf4d-8f0dee10a675
Sep 04 15:58:48 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:48 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:58:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:48 devstack sudo[99639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:58:48 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:49 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2a5f1772-1842-4018-baeb-67bb864c6564 tempest-VolumeImageDependencyTests-362996715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2633f930-600b-46e7-bf4d-8f0dee10a675" returned: 0 in 1.111s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2a5f1772-1842-4018-baeb-67bb864c6564 tempest-VolumeImageDependencyTests-362996715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2633f930-600b-46e7-bf4d-8f0dee10a675 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:49 devstack sudo[99645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2633f930-600b-46e7-bf4d-8f0dee10a675
Sep 04 15:58:49 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:49 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2a5f1772-1842-4018-baeb-67bb864c6564 tempest-VolumeImageDependencyTests-362996715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2633f930-600b-46e7-bf4d-8f0dee10a675" returned: 0 in 0.423s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2a5f1772-1842-4018-baeb-67bb864c6564 tempest-VolumeImageDependencyTests-362996715 None] Lock "cinder-quobyte-2633f930-600b-46e7-bf4d-8f0dee10a675" released by "delete_volume" :: held 1.682s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:49 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.840s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:49 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:58:49 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager._thread_info {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:58:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread count: 28 {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 15:58:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread info: [<_MainThread(MainThread, started 131673838448768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131673724603200)>, <Thread(Thread-3 (stat_writer), started daemon 131673723495936)>, <Thread(Rabbit-heartbeat, started daemon 131673723764800)>, <Thread(Thread-5 (_runner), started daemon 131673722269632)>, <Thread(Thread-7 (_runner), started daemon 131673722322112)>, <Thread(fd_logger, started daemon 131673722585024)>, <Thread(privsep_reader, started daemon 131673721593984)>, <Thread(tpool_thread_0, started daemon 131673714706112)>, <Thread(tpool_thread_1, started daemon 131673706313408)>, <Thread(tpool_thread_2, started daemon 131673697920704)>, <Thread(tpool_thread_3, started daemon 131673689528000)>, <Thread(tpool_thread_4, started daemon 131673681135296)>, <Thread(tpool_thread_5, started daemon 131673672726208)>, <Thread(tpool_thread_6, started daemon 131673664317120)>, <Thread(tpool_thread_7, started daemon 131673655908032)>, <Thread(tpool_thread_8, started daemon 131673647498944)>, <Thread(tpool_thread_9, started daemon 131673639089856)>, <Thread(tpool_thread_10, started daemon 131673630680768)>, <Thread(tpool_thread_11, started daemon 131673622271680)>, <Thread(tpool_thread_12, started daemon 131673613862592)>, <Thread(tpool_thread_13, started daemon 131673605453504)>, <Thread(tpool_thread_14, started daemon 131673597044416)>, <Thread(tpool_thread_15, started daemon 131673588635328)>, <Thread(tpool_thread_16, started daemon 131673580226240)>, <Thread(tpool_thread_17, started daemon 131673571817152)>, <Thread(tpool_thread_18, started daemon 131673563408064)>, <Thread(tpool_thread_19, started daemon 131673554998976)>] {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 15:58:49 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-2a5f1772-1842-4018-baeb-67bb864c6564 tempest-VolumeImageDependencyTests-362996715 None] Created reservations ['07c935f5-e86f-45bc-b871-86b665684078', 'b44e5b72-d64a-4e30-9a13-6bebac45fbcd', '4fcf9265-b3f3-4e46-9cda-b6afcaab5217', '7760499e-ae2c-4ce5-9b99-8fac276f4e99'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:58:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2a5f1772-1842-4018-baeb-67bb864c6564 tempest-VolumeImageDependencyTests-362996715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2a5f1772-1842-4018-baeb-67bb864c6564 tempest-VolumeImageDependencyTests-362996715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2a5f1772-1842-4018-baeb-67bb864c6564 tempest-VolumeImageDependencyTests-362996715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2a5f1772-1842-4018-baeb-67bb864c6564 tempest-VolumeImageDependencyTests-362996715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2a5f1772-1842-4018-baeb-67bb864c6564 tempest-VolumeImageDependencyTests-362996715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2a5f1772-1842-4018-baeb-67bb864c6564 tempest-VolumeImageDependencyTests-362996715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:50 devstack sudo[99650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:58:50 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:50 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2a5f1772-1842-4018-baeb-67bb864c6564 tempest-VolumeImageDependencyTests-362996715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.475s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:50 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-2a5f1772-1842-4018-baeb-67bb864c6564 tempest-VolumeImageDependencyTests-362996715 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:58:50 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-2a5f1772-1842-4018-baeb-67bb864c6564 tempest-VolumeImageDependencyTests-362996715 None] Deleted volume successfully.
Sep 04 15:58:50 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_986q5gpudevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-42491d8a-f512-43d2-937f-0d149699d8c3" returned: 0 in 4.859s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:50 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_986q5gpudevstack@QuobyteHD, size 112.00 MB, duration 4.86 sec, destination /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-42491d8a-f512-43d2-937f-0d149699d8c3 {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 15:58:50 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Converted 112.00 MB image at 23.05 MB/s
Sep 04 15:58:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-42491d8a-f512-43d2-937f-0d149699d8c3 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2a5f1772-1842-4018-baeb-67bb864c6564 tempest-VolumeImageDependencyTests-362996715 None] Lock "cinder-2633f930-600b-46e7-bf4d-8f0dee10a675-delete_volume" released by "delete_volume" :: held 2.954s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:50 devstack sudo[99653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-42491d8a-f512-43d2-937f-0d149699d8c3 1G
Sep 04 15:58:50 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:51 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-42491d8a-f512-43d2-937f-0d149699d8c3 1G" returned: 0 in 1.005s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:51 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Downloaded image 9488c80e-bb64-48e5-b1fb-9998fd167822 ((None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}])) to volume 42491d8a-f512-43d2-937f-0d149699d8c3 successfully. {{(pid=87504) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 04 15:58:51 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Temporary image 9488c80e-bb64-48e5-b1fb-9998fd167822 for user 10a29724348f4075ae4527bb5cc17b1e is deleted. {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 04 15:58:51 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Marking volume 42491d8a-f512-43d2-937f-0d149699d8c3 as bootable. {{(pid=87504) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 04 15:58:51 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Copying metadata from image 9488c80e-bb64-48e5-b1fb-9998fd167822 to 42491d8a-f512-43d2-937f-0d149699d8c3. {{(pid=87504) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 04 15:58:51 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Creating volume glance metadata for volume 42491d8a-f512-43d2-937f-0d149699d8c3 backed by image 9488c80e-bb64-48e5-b1fb-9998fd167822 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87504) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 04 15:58:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (828aa02e-24fe-4223-ba76-c01e1f12160b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42491d8a-f512-43d2-937f-0d149699d8c3', 'volume_size': 1, 'image_id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f6dbd3908a2d48468b7f486df9705903', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9488c80e-bb64-48e5-b1fb-9998fd167822/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1a2bcc920>}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548203e9-642d-41ac-a6fb-da635b44034f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:52 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Volume volume-42491d8a-f512-43d2-937f-0d149699d8c3 (42491d8a-f512-43d2-937f-0d149699d8c3): created successfully
Sep 04 15:58:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548203e9-642d-41ac-a6fb-da635b44034f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Flow 'volume_create_manager' (97db4f41-c568-4013-a1b7-1451cb74753f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:52 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-ec73c6ba-429d-4a65-b186-5aac2d18e2a5 tempest-VolumesImageMetadata-1556899897 None] Created volume successfully.
Sep 04 15:58:52 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-673cf41e-492d-4a2a-ac5f-02af36267041" returned: 0 in 6.723s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:52 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d, size 1024.00 MB, duration 6.72 sec, destination /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-673cf41e-492d-4a2a-ac5f-02af36267041 {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 15:58:52 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Converted 1024.00 MB image at 152.28 MB/s
Sep 04 15:58:52 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-673cf41e-492d-4a2a-ac5f-02af36267041 is being set with open permissions: ugo+rw
Sep 04 15:58:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-673cf41e-492d-4a2a-ac5f-02af36267041 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:52 devstack sudo[99658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-673cf41e-492d-4a2a-ac5f-02af36267041
Sep 04 15:58:52 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:52 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-673cf41e-492d-4a2a-ac5f-02af36267041" returned: 0 in 0.279s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-673cf41e-492d-4a2a-ac5f-02af36267041" released by "_copy_volume_from_snapshot" :: held 8.065s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-7e35480a-7ace-471a-a88f-febbb826207a-673cf41e-492d-4a2a-ac5f-02af36267041" released by "_create_volume_from_snapshot" :: held 8.163s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.186s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa40f61-3e3c-47a7-a361-ca335d1036cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-673cf41e-492d-4a2a-ac5f-02af36267041', 'volume_size': 2, 'snapshot_id': '7e35480a-7ace-471a-a88f-febbb826207a'}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (732d0137-d124-4c25-9ead-abf79684b54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:52 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Volume volume-673cf41e-492d-4a2a-ac5f-02af36267041 (673cf41e-492d-4a2a-ac5f-02af36267041): created successfully
Sep 04 15:58:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (732d0137-d124-4c25-9ead-abf79684b54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Flow 'volume_create_manager' (8eee4c19-6ad8-4233-99b2-09a04c969d62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:52 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-352fa688-c5f4-4c4b-853e-9e210a15720f tempest-VolumesSnapshotTestJSON-1945023076 None] Created volume successfully.
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3c14fd29-c508-4abf-8e9c-b08dcb4a2b03 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "cinder-673cf41e-492d-4a2a-ac5f-02af36267041-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3c14fd29-c508-4abf-8e9c-b08dcb4a2b03 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-673cf41e-492d-4a2a-ac5f-02af36267041-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3c14fd29-c508-4abf-8e9c-b08dcb4a2b03 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "cinder-quobyte-673cf41e-492d-4a2a-ac5f-02af36267041" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3c14fd29-c508-4abf-8e9c-b08dcb4a2b03 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-673cf41e-492d-4a2a-ac5f-02af36267041" acquired by "delete_volume" :: waited 0.039s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Flow 'volume_create_manager' (5e2d4a9e-19af-4f07-9667-257619de3201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae02a19-a243-4686-8ee9-3478bbaddf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[005354db-96ed-484f-b014-01a86a05c229]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3c14fd29-c508-4abf-8e9c-b08dcb4a2b03 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-673cf41e-492d-4a2a-ac5f-02af36267041 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae02a19-a243-4686-8ee9-3478bbaddf24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1789376163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e855710-95c0-4a18-9949-4b652fe0025e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a722a95f33845ffb67cc0e2a20d71d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:54Z,use_quota=True,user_id='75181d08489b4d2ab41546a85a30e217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (430b077b-aab5-48fc-96a2-3e4a1ba73f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (430b077b-aab5-48fc-96a2-3e4a1ba73f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb44e6dc-2cfe-4508-a763-2361491a179f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb44e6dc-2cfe-4508-a763-2361491a179f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e855710-95c0-4a18-9949-4b652fe0025e', 'volume_name': 'volume-1e855710-95c0-4a18-9949-4b652fe0025e', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (772a63c5-a9de-47f9-951a-215b994e07a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (772a63c5-a9de-47f9-951a-215b994e07a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c02d549-f785-47f7-b6cc-ccb18118401f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:53 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Volume 1e855710-95c0-4a18-9949-4b652fe0025e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e855710-95c0-4a18-9949-4b652fe0025e', 'volume_size': 1}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1789376163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e855710-95c0-4a18-9949-4b652fe0025e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a722a95f33845ffb67cc0e2a20d71d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:54Z,use_quota=True,user_id='75181d08489b4d2ab41546a85a30e217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Creating volume 1e855710-95c0-4a18-9949-4b652fe0025e {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:58:53 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1e855710-95c0-4a18-9949-4b652fe0025e 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:53 devstack sudo[99662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1e855710-95c0-4a18-9949-4b652fe0025e 1073741824
Sep 04 15:58:53 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:53 devstack sudo[99661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-673cf41e-492d-4a2a-ac5f-02af36267041
Sep 04 15:58:53 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e9a9583c-74fa-4802-909c-47fd6f58a442 tempest-VolumesImageMetadata-1556899897 None] Acquiring lock "cinder-42491d8a-f512-43d2-937f-0d149699d8c3-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e9a9583c-74fa-4802-909c-47fd6f58a442 tempest-VolumesImageMetadata-1556899897 None] Lock "cinder-42491d8a-f512-43d2-937f-0d149699d8c3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e9a9583c-74fa-4802-909c-47fd6f58a442 tempest-VolumesImageMetadata-1556899897 None] Acquiring lock "cinder-quobyte-42491d8a-f512-43d2-937f-0d149699d8c3" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e9a9583c-74fa-4802-909c-47fd6f58a442 tempest-VolumesImageMetadata-1556899897 None] Lock "cinder-quobyte-42491d8a-f512-43d2-937f-0d149699d8c3" acquired by "delete_volume" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[59abf3da-22be-4d1b-8355-7ffaea0e9945]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e9a9583c-74fa-4802-909c-47fd6f58a442 tempest-VolumesImageMetadata-1556899897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-42491d8a-f512-43d2-937f-0d149699d8c3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:54 devstack sudo[99667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-42491d8a-f512-43d2-937f-0d149699d8c3
Sep 04 15:58:54 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:54 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3c14fd29-c508-4abf-8e9c-b08dcb4a2b03 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-673cf41e-492d-4a2a-ac5f-02af36267041" returned: 0 in 0.556s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3c14fd29-c508-4abf-8e9c-b08dcb4a2b03 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-673cf41e-492d-4a2a-ac5f-02af36267041 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:54 devstack sudo[99675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-673cf41e-492d-4a2a-ac5f-02af36267041
Sep 04 15:58:54 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:54 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1e855710-95c0-4a18-9949-4b652fe0025e 1073741824" returned: 0 in 0.533s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1e855710-95c0-4a18-9949-4b652fe0025e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:54 devstack sudo[99677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1e855710-95c0-4a18-9949-4b652fe0025e
Sep 04 15:58:54 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:54 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e9a9583c-74fa-4802-909c-47fd6f58a442 tempest-VolumesImageMetadata-1556899897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-42491d8a-f512-43d2-937f-0d149699d8c3" returned: 0 in 0.465s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e9a9583c-74fa-4802-909c-47fd6f58a442 tempest-VolumesImageMetadata-1556899897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-42491d8a-f512-43d2-937f-0d149699d8c3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:54 devstack sudo[99684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-42491d8a-f512-43d2-937f-0d149699d8c3
Sep 04 15:58:54 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:54 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3c14fd29-c508-4abf-8e9c-b08dcb4a2b03 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-673cf41e-492d-4a2a-ac5f-02af36267041" returned: 0 in 0.333s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3c14fd29-c508-4abf-8e9c-b08dcb4a2b03 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-673cf41e-492d-4a2a-ac5f-02af36267041" released by "delete_volume" :: held 0.964s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-3c14fd29-c508-4abf-8e9c-b08dcb4a2b03 tempest-VolumesSnapshotTestJSON-1945023076 None] Created reservations ['962828eb-ead1-4913-9635-747ba5316096', '1263f724-9098-4b46-b721-f45f435e6aa3', '4e33bf55-54c4-4b26-8986-aa2b86c31331', '4f2e2964-a28a-4e91-a368-7a13e1a92bfe'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:58:54 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1e855710-95c0-4a18-9949-4b652fe0025e" returned: 0 in 0.377s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c02d549-f785-47f7-b6cc-ccb18118401f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e855710-95c0-4a18-9949-4b652fe0025e', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87f44db-11a9-4856-9144-3ba30a6558ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:54 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Volume volume-1e855710-95c0-4a18-9949-4b652fe0025e (1e855710-95c0-4a18-9949-4b652fe0025e): created successfully
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87f44db-11a9-4856-9144-3ba30a6558ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Flow 'volume_create_manager' (5e2d4a9e-19af-4f07-9667-257619de3201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:54 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-64b8dbfd-eb24-4152-a024-75f48951d555 tempest-VolumesListAdminTestJSON-1186074805 None] Created volume successfully.
Sep 04 15:58:54 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e9a9583c-74fa-4802-909c-47fd6f58a442 tempest-VolumesImageMetadata-1556899897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-42491d8a-f512-43d2-937f-0d149699d8c3" returned: 0 in 0.304s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e9a9583c-74fa-4802-909c-47fd6f58a442 tempest-VolumesImageMetadata-1556899897 None] Lock "cinder-quobyte-42491d8a-f512-43d2-937f-0d149699d8c3" released by "delete_volume" :: held 0.830s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3c14fd29-c508-4abf-8e9c-b08dcb4a2b03 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3c14fd29-c508-4abf-8e9c-b08dcb4a2b03 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3c14fd29-c508-4abf-8e9c-b08dcb4a2b03 tempest-VolumesSnapshotTestJSON-1945023076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3c14fd29-c508-4abf-8e9c-b08dcb4a2b03 tempest-VolumesSnapshotTestJSON-1945023076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3c14fd29-c508-4abf-8e9c-b08dcb4a2b03 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3c14fd29-c508-4abf-8e9c-b08dcb4a2b03 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:54 devstack sudo[99688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:58:54 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:54 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-e9a9583c-74fa-4802-909c-47fd6f58a442 tempest-VolumesImageMetadata-1556899897 None] Created reservations ['e3c277a1-3010-4225-a7c6-53b3afa4d755', '6a1ee9de-52de-4a3e-bd69-6068baa1b465', 'ac5b667c-fafc-4387-a0e9-d8c3f487876b', '53135873-24c4-4e3a-ab14-5826ff81544d'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e9a9583c-74fa-4802-909c-47fd6f58a442 tempest-VolumesImageMetadata-1556899897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e9a9583c-74fa-4802-909c-47fd6f58a442 tempest-VolumesImageMetadata-1556899897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e9a9583c-74fa-4802-909c-47fd6f58a442 tempest-VolumesImageMetadata-1556899897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e9a9583c-74fa-4802-909c-47fd6f58a442 tempest-VolumesImageMetadata-1556899897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e9a9583c-74fa-4802-909c-47fd6f58a442 tempest-VolumesImageMetadata-1556899897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e9a9583c-74fa-4802-909c-47fd6f58a442 tempest-VolumesImageMetadata-1556899897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:55 devstack sudo[99690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:58:55 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:55 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3c14fd29-c508-4abf-8e9c-b08dcb4a2b03 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.334s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-3c14fd29-c508-4abf-8e9c-b08dcb4a2b03 tempest-VolumesSnapshotTestJSON-1945023076 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:58:55 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-3c14fd29-c508-4abf-8e9c-b08dcb4a2b03 tempest-VolumesSnapshotTestJSON-1945023076 None] Deleted volume successfully.
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3c14fd29-c508-4abf-8e9c-b08dcb4a2b03 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-673cf41e-492d-4a2a-ac5f-02af36267041-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Flow 'volume_create_manager' (338c2e19-d1d5-458f-bf3c-f3aaf89ff0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (869fbc2a-ea47-4e2f-a175-a4302b69f94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (869fbc2a-ea47-4e2f-a175-a4302b69f94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ada7eeb-9647-4a7d-995a-129050d528f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b200b8a62047c4acba2a4f9e413a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:55Z,use_quota=True,user_id='99cd31b40d2d4476b5d2fdf9def86109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c092188-7919-4b17-bf1d-00eb28400af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c092188-7919-4b17-bf1d-00eb28400af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee3ee79-4548-472a-86b1-4f6e08cfb832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee3ee79-4548-472a-86b1-4f6e08cfb832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ada7eeb-9647-4a7d-995a-129050d528f7', 'volume_name': 'volume-9ada7eeb-9647-4a7d-995a-129050d528f7', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1befe75d-178d-4a9b-875f-762c02920c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1befe75d-178d-4a9b-875f-762c02920c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e14c1e-117c-4957-837c-375d6f0974f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:55 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Volume 9ada7eeb-9647-4a7d-995a-129050d528f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ada7eeb-9647-4a7d-995a-129050d528f7', 'volume_size': 1}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ada7eeb-9647-4a7d-995a-129050d528f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b200b8a62047c4acba2a4f9e413a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:55Z,use_quota=True,user_id='99cd31b40d2d4476b5d2fdf9def86109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Creating volume 9ada7eeb-9647-4a7d-995a-129050d528f7 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:58:55 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ada7eeb-9647-4a7d-995a-129050d528f7 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:55 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e9a9583c-74fa-4802-909c-47fd6f58a442 tempest-VolumesImageMetadata-1556899897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.366s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-e9a9583c-74fa-4802-909c-47fd6f58a442 tempest-VolumesImageMetadata-1556899897 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:58:55 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e9a9583c-74fa-4802-909c-47fd6f58a442 tempest-VolumesImageMetadata-1556899897 None] Deleted volume successfully.
Sep 04 15:58:55 devstack sudo[99694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ada7eeb-9647-4a7d-995a-129050d528f7 1073741824
Sep 04 15:58:55 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e9a9583c-74fa-4802-909c-47fd6f58a442 tempest-VolumesImageMetadata-1556899897 None] Lock "cinder-42491d8a-f512-43d2-937f-0d149699d8c3-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2d4f68eb-b49d-4d0e-8c6d-f5fb05e67b54 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "cinder-7e35480a-7ace-471a-a88f-febbb826207a-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2d4f68eb-b49d-4d0e-8c6d-f5fb05e67b54 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-7e35480a-7ace-471a-a88f-febbb826207a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2d4f68eb-b49d-4d0e-8c6d-f5fb05e67b54 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "cinder-quobyte-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2d4f68eb-b49d-4d0e-8c6d-f5fb05e67b54 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2d4f68eb-b49d-4d0e-8c6d-f5fb05e67b54 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "cinder-quobyte-7e35480a-7ace-471a-a88f-febbb826207a" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2d4f68eb-b49d-4d0e-8c6d-f5fb05e67b54 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-7e35480a-7ace-471a-a88f-febbb826207a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-2d4f68eb-b49d-4d0e-8c6d-f5fb05e67b54 tempest-VolumesSnapshotTestJSON-1945023076 None] Deleting offline snapshot 7e35480a-7ace-471a-a88f-febbb826207a of volume ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-2d4f68eb-b49d-4d0e-8c6d-f5fb05e67b54 tempest-VolumesSnapshotTestJSON-1945023076 None] snapshot_file for this snap is: volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.7e35480a-7ace-471a-a88f-febbb826207a {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ff7d19-1ef4-4493-b393-b326c16d23d9]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d4f68eb-b49d-4d0e-8c6d-f5fb05e67b54 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.7e35480a-7ace-471a-a88f-febbb826207a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:56 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ada7eeb-9647-4a7d-995a-129050d528f7 1073741824" returned: 0 in 0.666s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ada7eeb-9647-4a7d-995a-129050d528f7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:56 devstack sudo[99701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ada7eeb-9647-4a7d-995a-129050d528f7
Sep 04 15:58:56 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:56 devstack sudo[99700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.7e35480a-7ace-471a-a88f-febbb826207a
Sep 04 15:58:56 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:56 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ada7eeb-9647-4a7d-995a-129050d528f7" returned: 0 in 0.273s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e14c1e-117c-4957-837c-375d6f0974f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ada7eeb-9647-4a7d-995a-129050d528f7', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f21ea2-77d1-46a3-830f-69269ff40483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:56 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Volume volume-9ada7eeb-9647-4a7d-995a-129050d528f7 (9ada7eeb-9647-4a7d-995a-129050d528f7): created successfully
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f21ea2-77d1-46a3-830f-69269ff40483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Flow 'volume_create_manager' (338c2e19-d1d5-458f-bf3c-f3aaf89ff0e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Flow 'volume_create_manager' (938c00f1-7666-4162-8e5b-623a7014f36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39fba86c-11fc-41c6-9fb5-3f75efe01fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39fba86c-11fc-41c6-9fb5-3f75efe01fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-673645280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcfec116-947a-4017-856d-86fcfb4be41a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a722a95f33845ffb67cc0e2a20d71d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:56Z,use_quota=True,user_id='75181d08489b4d2ab41546a85a30e217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7bb633f-1fdc-40fa-acfd-dc7d2baf3924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7bb633f-1fdc-40fa-acfd-dc7d2baf3924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a852db-05d2-4720-99de-8ab1f4a02df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a852db-05d2-4720-99de-8ab1f4a02df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcfec116-947a-4017-856d-86fcfb4be41a', 'volume_name': 'volume-bcfec116-947a-4017-856d-86fcfb4be41a', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:56 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ef6f24-5982-4eca-965a-165340dc0e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ef6f24-5982-4eca-965a-165340dc0e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf16661-23e4-4974-99f1-da8ae9195c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:56 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Volume bcfec116-947a-4017-856d-86fcfb4be41a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcfec116-947a-4017-856d-86fcfb4be41a', 'volume_size': 1}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-673645280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcfec116-947a-4017-856d-86fcfb4be41a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a722a95f33845ffb67cc0e2a20d71d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:56Z,use_quota=True,user_id='75181d08489b4d2ab41546a85a30e217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Creating volume bcfec116-947a-4017-856d-86fcfb4be41a {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:58:56 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bcfec116-947a-4017-856d-86fcfb4be41a 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:56 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-71342cc4-75db-41c3-8faa-a8d32ec9f246 tempest-CinderUnicodeTest-2054414383 None] Created volume successfully.
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d4f68eb-b49d-4d0e-8c6d-f5fb05e67b54 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.7e35480a-7ace-471a-a88f-febbb826207a" returned: 0 in 0.550s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-2d4f68eb-b49d-4d0e-8c6d-f5fb05e67b54 tempest-VolumesSnapshotTestJSON-1945023076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:58:56 devstack sudo[99708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bcfec116-947a-4017-856d-86fcfb4be41a 1073741824
Sep 04 15:58:56 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[875fc7f9-0480-4ab2-acff-9301ab45145c]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d4f68eb-b49d-4d0e-8c6d-f5fb05e67b54 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:56 devstack sudo[99710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d
Sep 04 15:58:56 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:57 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bcfec116-947a-4017-856d-86fcfb4be41a 1073741824" returned: 0 in 0.503s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bcfec116-947a-4017-856d-86fcfb4be41a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:57 devstack sudo[99718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bcfec116-947a-4017-856d-86fcfb4be41a
Sep 04 15:58:57 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:57 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d4f68eb-b49d-4d0e-8c6d-f5fb05e67b54 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d" returned: 0 in 0.615s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d4f68eb-b49d-4d0e-8c6d-f5fb05e67b54 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.7e35480a-7ace-471a-a88f-febbb826207a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:57 devstack sudo[99721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.7e35480a-7ace-471a-a88f-febbb826207a
Sep 04 15:58:57 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:57 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bcfec116-947a-4017-856d-86fcfb4be41a" returned: 0 in 0.316s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:57 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:58:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf16661-23e4-4974-99f1-da8ae9195c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcfec116-947a-4017-856d-86fcfb4be41a', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76519177-5797-47d2-b7c7-38469abb3053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:57 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Volume volume-bcfec116-947a-4017-856d-86fcfb4be41a (bcfec116-947a-4017-856d-86fcfb4be41a): created successfully
Sep 04 15:58:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76519177-5797-47d2-b7c7-38469abb3053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Flow 'volume_create_manager' (938c00f1-7666-4162-8e5b-623a7014f36e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:57 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-bcee11f4-b994-4277-b74f-3455c0c85258 tempest-VolumesListAdminTestJSON-1186074805 None] Created volume successfully.
Sep 04 15:58:57 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d4f68eb-b49d-4d0e-8c6d-f5fb05e67b54 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.7e35480a-7ace-471a-a88f-febbb826207a" returned: 0 in 0.434s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d4f68eb-b49d-4d0e-8c6d-f5fb05e67b54 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.7e35480a-7ace-471a-a88f-febbb826207a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:57 devstack sudo[99728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.7e35480a-7ace-471a-a88f-febbb826207a
Sep 04 15:58:57 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:57 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d4f68eb-b49d-4d0e-8c6d-f5fb05e67b54 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d.7e35480a-7ace-471a-a88f-febbb826207a" returned: 0 in 0.291s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2d4f68eb-b49d-4d0e-8c6d-f5fb05e67b54 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-7e35480a-7ace-471a-a88f-febbb826207a" released by "_delete_snapshot" :: held 2.056s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2d4f68eb-b49d-4d0e-8c6d-f5fb05e67b54 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d" released by "delete_snapshot" :: held 2.087s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Flow 'volume_create_manager' (fdaf4f30-af9a-4e78-ae2f-7fd2ff85f5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43462e49-6d1b-406b-a915-1fd08a05f2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43462e49-6d1b-406b-a915-1fd08a05f2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1077826521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1beb885-9518-48f4-976c-80a9fb7ec2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b200b8a62047c4acba2a4f9e413a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:58Z,use_quota=True,user_id='99cd31b40d2d4476b5d2fdf9def86109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f414efe9-6e5f-40e6-86d1-95af1d006d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f414efe9-6e5f-40e6-86d1-95af1d006d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34bab64-fd29-4175-9461-b07f02291a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34bab64-fd29-4175-9461-b07f02291a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1beb885-9518-48f4-976c-80a9fb7ec2fe', 'volume_name': 'volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f7c160-d31f-4252-8ac1-1d21740b3f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f7c160-d31f-4252-8ac1-1d21740b3f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f95f36-8707-4bf3-9b1a-c493176c3479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:58 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Volume e1beb885-9518-48f4-976c-80a9fb7ec2fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe', 'volume_size': 1}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1077826521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1beb885-9518-48f4-976c-80a9fb7ec2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b200b8a62047c4acba2a4f9e413a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:58Z,use_quota=True,user_id='99cd31b40d2d4476b5d2fdf9def86109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Creating volume e1beb885-9518-48f4-976c-80a9fb7ec2fe {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:58:58 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:58 devstack sudo[99731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe 1073741824
Sep 04 15:58:58 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-2d4f68eb-b49d-4d0e-8c6d-f5fb05e67b54 tempest-VolumesSnapshotTestJSON-1945023076 None] Created reservations ['cbec1897-fed9-48de-a649-3c4cdeaeab7c', '16d0b70e-90b4-455d-b2d3-bb8d24c07e04', '74a4c4fe-83ca-4635-9df3-f1870712133d', 'cb4d7a60-2cc2-4642-9379-2113e4130487'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:58:58 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-2d4f68eb-b49d-4d0e-8c6d-f5fb05e67b54 tempest-VolumesSnapshotTestJSON-1945023076 None] Delete snapshot completed successfully.
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2d4f68eb-b49d-4d0e-8c6d-f5fb05e67b54 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-7e35480a-7ace-471a-a88f-febbb826207a-delete_snapshot" released by "delete_snapshot" :: held 2.366s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:58:58 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe 1073741824" returned: 0 in 0.551s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:58 devstack sudo[99736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe
Sep 04 15:58:58 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Flow 'volume_create_manager' (c3d579d6-88e9-4472-8cf5-f70f4c107e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39893f39-80cd-49c8-bc73-c8e18e42d98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39893f39-80cd-49c8-bc73-c8e18e42d98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1095766758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a27f8d-989f-4a26-9c19-dad08b34b02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac80d1ddc3e74c7382484882e4137374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:59Z,use_quota=True,user_id='ad32d61275994264bc85c680d52d45a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e9ce57-5ee4-4259-ae82-12ad7afe36ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e9ce57-5ee4-4259-ae82-12ad7afe36ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572becc4-ea93-440b-bd52-d3729a17d09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572becc4-ea93-440b-bd52-d3729a17d09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36a27f8d-989f-4a26-9c19-dad08b34b02c', 'volume_name': 'volume-36a27f8d-989f-4a26-9c19-dad08b34b02c', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b5550e-c1af-473f-ba2b-1c1c775d7454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b5550e-c1af-473f-ba2b-1c1c775d7454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad0daa7e-8319-4553-aac2-b065e16f51d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:59 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Volume 36a27f8d-989f-4a26-9c19-dad08b34b02c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36a27f8d-989f-4a26-9c19-dad08b34b02c', 'volume_size': 1}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:59 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe" returned: 0 in 0.351s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.109s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1095766758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a27f8d-989f-4a26-9c19-dad08b34b02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac80d1ddc3e74c7382484882e4137374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:59Z,use_quota=True,user_id='ad32d61275994264bc85c680d52d45a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Creating volume 36a27f8d-989f-4a26-9c19-dad08b34b02c {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:58:59 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f95f36-8707-4bf3-9b1a-c493176c3479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a49628c-c199-4db2-a218-141426f250a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:59 devstack sudo[99739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c 1073741824
Sep 04 15:58:59 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:59 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Volume volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe (e1beb885-9518-48f4-976c-80a9fb7ec2fe): created successfully
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a49628c-c199-4db2-a218-141426f250a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Flow 'volume_create_manager' (fdaf4f30-af9a-4e78-ae2f-7fd2ff85f5ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d832fb3b-baee-40fc-acea-4b6709256e4f tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "cinder-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:59 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-668ecfbd-956e-4b38-8385-84afc3443672 tempest-CinderUnicodeTest-2054414383 None] Created volume successfully.
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d832fb3b-baee-40fc-acea-4b6709256e4f tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Flow 'volume_create_manager' (48392ce3-1ed9-4ca4-99a4-fe3eec3dceac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f2a7e19-cf92-4c20-8ccf-cf3567a6136a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d832fb3b-baee-40fc-acea-4b6709256e4f tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "cinder-quobyte-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f2a7e19-cf92-4c20-8ccf-cf3567a6136a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-713470738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc145226-5671-421d-a5e7-b52253ed669f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a722a95f33845ffb67cc0e2a20d71d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:59Z,use_quota=True,user_id='75181d08489b4d2ab41546a85a30e217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd5aa3b-5a80-4747-8b99-cac006bb73a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd5aa3b-5a80-4747-8b99-cac006bb73a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ddcf494-93f0-487d-8c75-923e60b8b377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ddcf494-93f0-487d-8c75-923e60b8b377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc145226-5671-421d-a5e7-b52253ed669f', 'volume_name': 'volume-bc145226-5671-421d-a5e7-b52253ed669f', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6fe93c-febc-4e08-bfc2-330ae646b33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6fe93c-febc-4e08-bfc2-330ae646b33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30212d30-a18d-4c3a-9687-22421051c26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:58:59 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Volume bc145226-5671-421d-a5e7-b52253ed669f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc145226-5671-421d-a5e7-b52253ed669f', 'volume_size': 1}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d832fb3b-baee-40fc-acea-4b6709256e4f tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d" acquired by "delete_volume" :: waited 0.067s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa41738d-82f0-46af-aef3-5d1cd159c94d]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d832fb3b-baee-40fc-acea-4b6709256e4f tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:59 devstack sudo[99744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d
Sep 04 15:58:59 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:59 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c 1073741824" returned: 0 in 0.507s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:59 devstack sudo[99747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c
Sep 04 15:58:59 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:58:59 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d832fb3b-baee-40fc-acea-4b6709256e4f tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d" returned: 0 in 0.452s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:58:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d832fb3b-baee-40fc-acea-4b6709256e4f tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:58:59 devstack sudo[99752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d
Sep 04 15:58:59 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:00 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c" returned: 0 in 0.354s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.672s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-713470738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc145226-5671-421d-a5e7-b52253ed669f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a722a95f33845ffb67cc0e2a20d71d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:59Z,use_quota=True,user_id='75181d08489b4d2ab41546a85a30e217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Creating volume bc145226-5671-421d-a5e7-b52253ed669f {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:59:00 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bc145226-5671-421d-a5e7-b52253ed669f 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad0daa7e-8319-4553-aac2-b065e16f51d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36a27f8d-989f-4a26-9c19-dad08b34b02c', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:00 devstack sudo[99755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bc145226-5671-421d-a5e7-b52253ed669f 1073741824
Sep 04 15:59:00 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6523f1a3-5e42-422f-a99c-130e9f84916a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:00 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Volume volume-36a27f8d-989f-4a26-9c19-dad08b34b02c (36a27f8d-989f-4a26-9c19-dad08b34b02c): created successfully
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6523f1a3-5e42-422f-a99c-130e9f84916a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Flow 'volume_create_manager' (c3d579d6-88e9-4472-8cf5-f70f4c107e60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:00 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-d4bf4940-0fe1-4f97-a6e7-5a4cb80fbba4 tempest-SnapshotMetadataTestJSON-1071113656 None] Created volume successfully.
Sep 04 15:59:00 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d832fb3b-baee-40fc-acea-4b6709256e4f tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d" returned: 0 in 0.342s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d832fb3b-baee-40fc-acea-4b6709256e4f tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d" released by "delete_volume" :: held 0.861s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-d832fb3b-baee-40fc-acea-4b6709256e4f tempest-VolumesSnapshotTestJSON-1945023076 None] Created reservations ['9c824ac0-dc81-4879-95e9-11ef290172e2', 'f9bdd7a6-de16-4cb7-900f-7fada31aa48b', '601630a0-96f5-442b-87a8-f4be5d8421fb', '4fcd81fa-1bae-46e3-8f4b-7b673fe60f2e'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d832fb3b-baee-40fc-acea-4b6709256e4f tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d832fb3b-baee-40fc-acea-4b6709256e4f tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d832fb3b-baee-40fc-acea-4b6709256e4f tempest-VolumesSnapshotTestJSON-1945023076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d832fb3b-baee-40fc-acea-4b6709256e4f tempest-VolumesSnapshotTestJSON-1945023076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d832fb3b-baee-40fc-acea-4b6709256e4f tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d832fb3b-baee-40fc-acea-4b6709256e4f tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:00 devstack sudo[99761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:59:00 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-13178eb8-e8a2-477e-b99c-26eb0ea8a080 tempest-CinderUnicodeTest-2054414383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:00 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bc145226-5671-421d-a5e7-b52253ed669f 1073741824" returned: 0 in 0.580s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bc145226-5671-421d-a5e7-b52253ed669f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:00 devstack sudo[99764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bc145226-5671-421d-a5e7-b52253ed669f
Sep 04 15:59:00 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:00 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d832fb3b-baee-40fc-acea-4b6709256e4f tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.342s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-d832fb3b-baee-40fc-acea-4b6709256e4f tempest-VolumesSnapshotTestJSON-1945023076 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:59:00 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-d832fb3b-baee-40fc-acea-4b6709256e4f tempest-VolumesSnapshotTestJSON-1945023076 None] Deleted volume successfully.
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d832fb3b-baee-40fc-acea-4b6709256e4f tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-ea5a3554-d0e8-4008-9ea5-06a5b4ecc54d-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:00 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bc145226-5671-421d-a5e7-b52253ed669f" returned: 0 in 0.273s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-13178eb8-e8a2-477e-b99c-26eb0ea8a080 tempest-CinderUnicodeTest-2054414383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.429s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30212d30-a18d-4c3a-9687-22421051c26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc145226-5671-421d-a5e7-b52253ed669f', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6bbc5e-9286-434c-a1fb-cb26ca5b0e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-13178eb8-e8a2-477e-b99c-26eb0ea8a080 tempest-CinderUnicodeTest-2054414383 None] Creating offline snapshot bf16bf3b-0f9a-4d84-9931-4d1382c013c0 of volume e1beb885-9518-48f4-976c-80a9fb7ec2fe {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:59:00 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Volume volume-bc145226-5671-421d-a5e7-b52253ed669f (bc145226-5671-421d-a5e7-b52253ed669f): created successfully
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6bbc5e-9286-434c-a1fb-cb26ca5b0e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Flow 'volume_create_manager' (48392ce3-1ed9-4ca4-99a4-fe3eec3dceac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:01 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ef6a04-f0d5-4ee5-8685-0acc4ce9ec60]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-13178eb8-e8a2-477e-b99c-26eb0ea8a080 tempest-CinderUnicodeTest-2054414383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:01 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-d52bb2f8-8611-4db7-94f0-b1824851e7db tempest-VolumesListAdminTestJSON-1186074805 None] Created volume successfully.
Sep 04 15:59:01 devstack sudo[99768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe
Sep 04 15:59:01 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6f879dd4-fe1b-44fc-a71c-a06e911904a1 tempest-SnapshotMetadataTestJSON-1071113656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:01 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-13178eb8-e8a2-477e-b99c-26eb0ea8a080 tempest-CinderUnicodeTest-2054414383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe" returned: 0 in 0.369s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-13178eb8-e8a2-477e-b99c-26eb0ea8a080 tempest-CinderUnicodeTest-2054414383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.bf16bf3b-0f9a-4d84-9931-4d1382c013c0 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:01 devstack sudo[99773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.bf16bf3b-0f9a-4d84-9931-4d1382c013c0 1G
Sep 04 15:59:01 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:01 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-13178eb8-e8a2-477e-b99c-26eb0ea8a080 tempest-CinderUnicodeTest-2054414383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.bf16bf3b-0f9a-4d84-9931-4d1382c013c0 1G" returned: 0 in 0.550s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-13178eb8-e8a2-477e-b99c-26eb0ea8a080 tempest-CinderUnicodeTest-2054414383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.bf16bf3b-0f9a-4d84-9931-4d1382c013c0 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:01 devstack sudo[99782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.bf16bf3b-0f9a-4d84-9931-4d1382c013c0
Sep 04 15:59:01 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Flow 'volume_create_manager' (22d8c343-a97c-40c6-b833-c0124116b5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c73c5a-eb8b-4515-baee-d159ee5b3812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c73c5a-eb8b-4515-baee-d159ee5b3812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-29264453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=008d2f8f-e712-4cbc-bf74-f15c040a88e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a7f9e6404314a50af699cb79d79e676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:02Z,use_quota=True,user_id='32f390736f114e0c942690ded0dff859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11052ffd-61b5-4d26-94c1-17e9581369f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11052ffd-61b5-4d26-94c1-17e9581369f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f8982c5-8b08-45fa-a775-719b0cf3ded4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f8982c5-8b08-45fa-a775-719b0cf3ded4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '008d2f8f-e712-4cbc-bf74-f15c040a88e7', 'volume_name': 'volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d1cc01-c2ea-48c8-9bae-bfa3f44ee96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d1cc01-c2ea-48c8-9bae-bfa3f44ee96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbfdbb69-7c5e-46c5-bdad-0168b618fcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:02 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Volume 008d2f8f-e712-4cbc-bf74-f15c040a88e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7', 'volume_size': 1}
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:02 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-13178eb8-e8a2-477e-b99c-26eb0ea8a080 tempest-CinderUnicodeTest-2054414383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.bf16bf3b-0f9a-4d84-9931-4d1382c013c0" returned: 0 in 0.427s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:02 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-13178eb8-e8a2-477e-b99c-26eb0ea8a080 tempest-CinderUnicodeTest-2054414383 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.bf16bf3b-0f9a-4d84-9931-4d1382c013c0 is being set with open permissions: ugo+rw
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-13178eb8-e8a2-477e-b99c-26eb0ea8a080 tempest-CinderUnicodeTest-2054414383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.bf16bf3b-0f9a-4d84-9931-4d1382c013c0 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:02 devstack sudo[99821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.bf16bf3b-0f9a-4d84-9931-4d1382c013c0
Sep 04 15:59:02 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Flow 'volume_create_manager' (236f9ef8-bed7-4d5e-9765-592ef1cf3f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bd13423-bf04-46d4-91db-e193c08fc229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bd13423-bf04-46d4-91db-e193c08fc229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=489d6ac4-3609-4405-a3b2-41db0a96cc5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f06a8fc1614f6dab2ac2e281e65e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:02Z,use_quota=True,user_id='9e94c460df044908aef663054b6b2a3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057ada1d-4576-4703-a5f0-b701417f0ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057ada1d-4576-4703-a5f0-b701417f0ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b19276-c258-4a15-815e-22a416a3efcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b19276-c258-4a15-815e-22a416a3efcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '489d6ac4-3609-4405-a3b2-41db0a96cc5f', 'volume_name': 'volume-489d6ac4-3609-4405-a3b2-41db0a96cc5f', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7da86ef-12fc-4b8e-9c01-7e41b30c3732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7da86ef-12fc-4b8e-9c01-7e41b30c3732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d22ea1-8f9b-4167-ad10-dbdcff3dcb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:02 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Volume 489d6ac4-3609-4405-a3b2-41db0a96cc5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-489d6ac4-3609-4405-a3b2-41db0a96cc5f', 'volume_size': 1}
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:02 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-13178eb8-e8a2-477e-b99c-26eb0ea8a080 tempest-CinderUnicodeTest-2054414383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.bf16bf3b-0f9a-4d84-9931-4d1382c013c0" returned: 0 in 0.280s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-13178eb8-e8a2-477e-b99c-26eb0ea8a080 tempest-CinderUnicodeTest-2054414383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:02 devstack sudo[99824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.info
Sep 04 15:59:02 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:02 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-13178eb8-e8a2-477e-b99c-26eb0ea8a080 tempest-CinderUnicodeTest-2054414383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.info" returned: 0 in 0.241s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:02 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-13178eb8-e8a2-477e-b99c-26eb0ea8a080 tempest-CinderUnicodeTest-2054414383 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.info is being set with open permissions: ugo+rw
Sep 04 15:59:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-13178eb8-e8a2-477e-b99c-26eb0ea8a080 tempest-CinderUnicodeTest-2054414383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:02 devstack sudo[99827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.info
Sep 04 15:59:02 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:03 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-13178eb8-e8a2-477e-b99c-26eb0ea8a080 tempest-CinderUnicodeTest-2054414383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.info" returned: 0 in 0.255s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-13178eb8-e8a2-477e-b99c-26eb0ea8a080 tempest-CinderUnicodeTest-2054414383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.233s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6f879dd4-fe1b-44fc-a71c-a06e911904a1 tempest-SnapshotMetadataTestJSON-1071113656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.023s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:03 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-6f879dd4-fe1b-44fc-a71c-a06e911904a1 tempest-SnapshotMetadataTestJSON-1071113656 None] Creating offline snapshot 85971827-eaf6-4f41-ac08-d616c724ae00 of volume 36a27f8d-989f-4a26-9c19-dad08b34b02c {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:59:03 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-13178eb8-e8a2-477e-b99c-26eb0ea8a080 tempest-CinderUnicodeTest-2054414383 None] Create snapshot completed successfully
Sep 04 15:59:03 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[94803e01-f623-44e3-8225-4f18c3c60ad6]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f879dd4-fe1b-44fc-a71c-a06e911904a1 tempest-SnapshotMetadataTestJSON-1071113656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:03 devstack sudo[99830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c
Sep 04 15:59:03 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:03 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f879dd4-fe1b-44fc-a71c-a06e911904a1 tempest-SnapshotMetadataTestJSON-1071113656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c" returned: 0 in 0.359s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f879dd4-fe1b-44fc-a71c-a06e911904a1 tempest-SnapshotMetadataTestJSON-1071113656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.85971827-eaf6-4f41-ac08-d616c724ae00 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:03 devstack sudo[99836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.85971827-eaf6-4f41-ac08-d616c724ae00 1G
Sep 04 15:59:03 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:03 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0212b14b-7434-4df0-bd24-f6c910b81b84 tempest-CinderUnicodeTest-2054414383 None] Acquiring lock "cinder-bf16bf3b-0f9a-4d84-9931-4d1382c013c0-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:03 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0212b14b-7434-4df0-bd24-f6c910b81b84 tempest-CinderUnicodeTest-2054414383 None] Lock "cinder-bf16bf3b-0f9a-4d84-9931-4d1382c013c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:03 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0212b14b-7434-4df0-bd24-f6c910b81b84 tempest-CinderUnicodeTest-2054414383 None] Acquiring lock "cinder-quobyte-e1beb885-9518-48f4-976c-80a9fb7ec2fe" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:03 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0212b14b-7434-4df0-bd24-f6c910b81b84 tempest-CinderUnicodeTest-2054414383 None] Lock "cinder-quobyte-e1beb885-9518-48f4-976c-80a9fb7ec2fe" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:03 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0212b14b-7434-4df0-bd24-f6c910b81b84 tempest-CinderUnicodeTest-2054414383 None] Acquiring lock "cinder-quobyte-bf16bf3b-0f9a-4d84-9931-4d1382c013c0" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:03 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0212b14b-7434-4df0-bd24-f6c910b81b84 tempest-CinderUnicodeTest-2054414383 None] Lock "cinder-quobyte-bf16bf3b-0f9a-4d84-9931-4d1382c013c0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:03 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-0212b14b-7434-4df0-bd24-f6c910b81b84 tempest-CinderUnicodeTest-2054414383 None] Deleting offline snapshot bf16bf3b-0f9a-4d84-9931-4d1382c013c0 of volume e1beb885-9518-48f4-976c-80a9fb7ec2fe {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 15:59:03 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-0212b14b-7434-4df0-bd24-f6c910b81b84 tempest-CinderUnicodeTest-2054414383 None] snapshot_file for this snap is: volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.bf16bf3b-0f9a-4d84-9931-4d1382c013c0 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 15:59:03 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5ea31b-c1d8-43e0-a143-b59da98fcc0b]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0212b14b-7434-4df0-bd24-f6c910b81b84 tempest-CinderUnicodeTest-2054414383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.bf16bf3b-0f9a-4d84-9931-4d1382c013c0 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:03 devstack sudo[99838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.bf16bf3b-0f9a-4d84-9931-4d1382c013c0
Sep 04 15:59:03 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:04 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f879dd4-fe1b-44fc-a71c-a06e911904a1 tempest-SnapshotMetadataTestJSON-1071113656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.85971827-eaf6-4f41-ac08-d616c724ae00 1G" returned: 0 in 0.446s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f879dd4-fe1b-44fc-a71c-a06e911904a1 tempest-SnapshotMetadataTestJSON-1071113656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a27f8d-989f-4a26-9c19-dad08b34b02c -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.85971827-eaf6-4f41-ac08-d616c724ae00 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:04 devstack sudo[99844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a27f8d-989f-4a26-9c19-dad08b34b02c -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.85971827-eaf6-4f41-ac08-d616c724ae00
Sep 04 15:59:04 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:04 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0212b14b-7434-4df0-bd24-f6c910b81b84 tempest-CinderUnicodeTest-2054414383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.bf16bf3b-0f9a-4d84-9931-4d1382c013c0" returned: 0 in 0.418s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:04 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-0212b14b-7434-4df0-bd24-f6c910b81b84 tempest-CinderUnicodeTest-2054414383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:59:04 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa0c703-e5f2-4f35-a59d-111a1f930802]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0212b14b-7434-4df0-bd24-f6c910b81b84 tempest-CinderUnicodeTest-2054414383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:04 devstack sudo[99851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe
Sep 04 15:59:04 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:04 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f879dd4-fe1b-44fc-a71c-a06e911904a1 tempest-SnapshotMetadataTestJSON-1071113656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a27f8d-989f-4a26-9c19-dad08b34b02c -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.85971827-eaf6-4f41-ac08-d616c724ae00" returned: 0 in 0.282s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:04 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-6f879dd4-fe1b-44fc-a71c-a06e911904a1 tempest-SnapshotMetadataTestJSON-1071113656 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.85971827-eaf6-4f41-ac08-d616c724ae00 is being set with open permissions: ugo+rw
Sep 04 15:59:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f879dd4-fe1b-44fc-a71c-a06e911904a1 tempest-SnapshotMetadataTestJSON-1071113656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.85971827-eaf6-4f41-ac08-d616c724ae00 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:04 devstack sudo[99856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.85971827-eaf6-4f41-ac08-d616c724ae00
Sep 04 15:59:04 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:04 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0212b14b-7434-4df0-bd24-f6c910b81b84 tempest-CinderUnicodeTest-2054414383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe" returned: 0 in 0.385s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0212b14b-7434-4df0-bd24-f6c910b81b84 tempest-CinderUnicodeTest-2054414383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.bf16bf3b-0f9a-4d84-9931-4d1382c013c0 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:04 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f879dd4-fe1b-44fc-a71c-a06e911904a1 tempest-SnapshotMetadataTestJSON-1071113656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.85971827-eaf6-4f41-ac08-d616c724ae00" returned: 0 in 0.260s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:04 devstack sudo[99862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.bf16bf3b-0f9a-4d84-9931-4d1382c013c0
Sep 04 15:59:04 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f879dd4-fe1b-44fc-a71c-a06e911904a1 tempest-SnapshotMetadataTestJSON-1071113656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:04 devstack sudo[99864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.info
Sep 04 15:59:04 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:04 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f879dd4-fe1b-44fc-a71c-a06e911904a1 tempest-SnapshotMetadataTestJSON-1071113656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.info" returned: 0 in 0.271s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:04 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-6f879dd4-fe1b-44fc-a71c-a06e911904a1 tempest-SnapshotMetadataTestJSON-1071113656 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.info is being set with open permissions: ugo+rw
Sep 04 15:59:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f879dd4-fe1b-44fc-a71c-a06e911904a1 tempest-SnapshotMetadataTestJSON-1071113656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:04 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0212b14b-7434-4df0-bd24-f6c910b81b84 tempest-CinderUnicodeTest-2054414383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.bf16bf3b-0f9a-4d84-9931-4d1382c013c0" returned: 0 in 0.336s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0212b14b-7434-4df0-bd24-f6c910b81b84 tempest-CinderUnicodeTest-2054414383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.bf16bf3b-0f9a-4d84-9931-4d1382c013c0 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:04 devstack sudo[99870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.info
Sep 04 15:59:04 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:04 devstack sudo[99871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.bf16bf3b-0f9a-4d84-9931-4d1382c013c0
Sep 04 15:59:04 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:05 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6f879dd4-fe1b-44fc-a71c-a06e911904a1 tempest-SnapshotMetadataTestJSON-1071113656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.info" returned: 0 in 0.270s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:05 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6f879dd4-fe1b-44fc-a71c-a06e911904a1 tempest-SnapshotMetadataTestJSON-1071113656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.916s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-29264453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=008d2f8f-e712-4cbc-bf74-f15c040a88e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a7f9e6404314a50af699cb79d79e676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:02Z,use_quota=True,user_id='32f390736f114e0c942690ded0dff859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:59:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Creating volume 008d2f8f-e712-4cbc-bf74-f15c040a88e7 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:59:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:59:05 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:59:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0212b14b-7434-4df0-bd24-f6c910b81b84 tempest-CinderUnicodeTest-2054414383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe.bf16bf3b-0f9a-4d84-9931-4d1382c013c0" returned: 0 in 0.309s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:05 devstack sudo[99876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7 1073741824
Sep 04 15:59:05 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:05 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-6f879dd4-fe1b-44fc-a71c-a06e911904a1 tempest-SnapshotMetadataTestJSON-1071113656 None] Create snapshot completed successfully
Sep 04 15:59:05 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0212b14b-7434-4df0-bd24-f6c910b81b84 tempest-CinderUnicodeTest-2054414383 None] Lock "cinder-quobyte-bf16bf3b-0f9a-4d84-9931-4d1382c013c0" released by "_delete_snapshot" :: held 1.561s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:05 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0212b14b-7434-4df0-bd24-f6c910b81b84 tempest-CinderUnicodeTest-2054414383 None] Lock "cinder-quobyte-e1beb885-9518-48f4-976c-80a9fb7ec2fe" released by "delete_snapshot" :: held 1.590s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:05 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-0212b14b-7434-4df0-bd24-f6c910b81b84 tempest-CinderUnicodeTest-2054414383 None] Created reservations ['6482c6a4-72e6-4669-acbf-3022f7d70307', 'adafaf06-0557-4f84-bc29-adaded6bf689', 'f6539780-6370-4580-91e2-18416471072e', '3edf35a1-d79b-4e69-a9da-9fba08b2b6ae'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:59:05 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-0212b14b-7434-4df0-bd24-f6c910b81b84 tempest-CinderUnicodeTest-2054414383 None] Delete snapshot completed successfully.
Sep 04 15:59:05 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0212b14b-7434-4df0-bd24-f6c910b81b84 tempest-CinderUnicodeTest-2054414383 None] Lock "cinder-bf16bf3b-0f9a-4d84-9931-4d1382c013c0-delete_snapshot" released by "delete_snapshot" :: held 1.761s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:05 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7 1073741824" returned: 0 in 0.516s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:05 devstack sudo[99882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7
Sep 04 15:59:05 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:05 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-45c1854c-b012-477c-8689-d1d5029c8a2e tempest-CinderUnicodeTest-2054414383 None] Acquiring lock "cinder-e1beb885-9518-48f4-976c-80a9fb7ec2fe-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:05 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-45c1854c-b012-477c-8689-d1d5029c8a2e tempest-CinderUnicodeTest-2054414383 None] Lock "cinder-e1beb885-9518-48f4-976c-80a9fb7ec2fe-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:05 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-45c1854c-b012-477c-8689-d1d5029c8a2e tempest-CinderUnicodeTest-2054414383 None] Acquiring lock "cinder-quobyte-e1beb885-9518-48f4-976c-80a9fb7ec2fe" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:05 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-45c1854c-b012-477c-8689-d1d5029c8a2e tempest-CinderUnicodeTest-2054414383 None] Lock "cinder-quobyte-e1beb885-9518-48f4-976c-80a9fb7ec2fe" acquired by "delete_volume" :: waited 0.016s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:05 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4793bb-9243-4a67-8441-994b884232b7]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-45c1854c-b012-477c-8689-d1d5029c8a2e tempest-CinderUnicodeTest-2054414383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:06 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7" returned: 0 in 0.329s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.598s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=489d6ac4-3609-4405-a3b2-41db0a96cc5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f06a8fc1614f6dab2ac2e281e65e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:02Z,use_quota=True,user_id='9e94c460df044908aef663054b6b2a3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Creating volume 489d6ac4-3609-4405-a3b2-41db0a96cc5f {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:59:06 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:59:06 devstack sudo[99884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-489d6ac4-3609-4405-a3b2-41db0a96cc5f 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:06 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:06 devstack sudo[99887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-489d6ac4-3609-4405-a3b2-41db0a96cc5f 1073741824
Sep 04 15:59:06 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbfdbb69-7c5e-46c5-bdad-0168b618fcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a1fe60-9928-4812-b58b-a27d4102ade6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:06 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Volume volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7 (008d2f8f-e712-4cbc-bf74-f15c040a88e7): created successfully
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a1fe60-9928-4812-b58b-a27d4102ade6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Flow 'volume_create_manager' (22d8c343-a97c-40c6-b833-c0124116b5d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:06 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e37029dd-c998-4ba0-8c1f-0cfd3cb5bf43 tempest-VolumesSnapshotTestJSON-1945023076 None] Created volume successfully.
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7d516b28-4e02-4375-82a8-e27d4855454a tempest-SnapshotMetadataTestJSON-1071113656 None] Acquiring lock "cinder-85971827-eaf6-4f41-ac08-d616c724ae00-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7d516b28-4e02-4375-82a8-e27d4855454a tempest-SnapshotMetadataTestJSON-1071113656 None] Lock "cinder-85971827-eaf6-4f41-ac08-d616c724ae00-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7d516b28-4e02-4375-82a8-e27d4855454a tempest-SnapshotMetadataTestJSON-1071113656 None] Acquiring lock "cinder-quobyte-36a27f8d-989f-4a26-9c19-dad08b34b02c" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7d516b28-4e02-4375-82a8-e27d4855454a tempest-SnapshotMetadataTestJSON-1071113656 None] Lock "cinder-quobyte-36a27f8d-989f-4a26-9c19-dad08b34b02c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7d516b28-4e02-4375-82a8-e27d4855454a tempest-SnapshotMetadataTestJSON-1071113656 None] Acquiring lock "cinder-quobyte-85971827-eaf6-4f41-ac08-d616c724ae00" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7d516b28-4e02-4375-82a8-e27d4855454a tempest-SnapshotMetadataTestJSON-1071113656 None] Lock "cinder-quobyte-85971827-eaf6-4f41-ac08-d616c724ae00" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-7d516b28-4e02-4375-82a8-e27d4855454a tempest-SnapshotMetadataTestJSON-1071113656 None] Deleting offline snapshot 85971827-eaf6-4f41-ac08-d616c724ae00 of volume 36a27f8d-989f-4a26-9c19-dad08b34b02c {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-7d516b28-4e02-4375-82a8-e27d4855454a tempest-SnapshotMetadataTestJSON-1071113656 None] snapshot_file for this snap is: volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.85971827-eaf6-4f41-ac08-d616c724ae00 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfe8200-8e48-4cf5-9a01-fec6fffda03c]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7d516b28-4e02-4375-82a8-e27d4855454a tempest-SnapshotMetadataTestJSON-1071113656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.85971827-eaf6-4f41-ac08-d616c724ae00 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:06 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-45c1854c-b012-477c-8689-d1d5029c8a2e tempest-CinderUnicodeTest-2054414383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe" returned: 0 in 0.531s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-45c1854c-b012-477c-8689-d1d5029c8a2e tempest-CinderUnicodeTest-2054414383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:06 devstack sudo[99896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe
Sep 04 15:59:06 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:06 devstack sudo[99894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.85971827-eaf6-4f41-ac08-d616c724ae00
Sep 04 15:59:06 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7c409f79-5977-4e74-a869-582316d90c6d tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:06 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-489d6ac4-3609-4405-a3b2-41db0a96cc5f 1073741824" returned: 0 in 0.610s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-489d6ac4-3609-4405-a3b2-41db0a96cc5f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:06 devstack sudo[99900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-489d6ac4-3609-4405-a3b2-41db0a96cc5f
Sep 04 15:59:06 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:06 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-45c1854c-b012-477c-8689-d1d5029c8a2e tempest-CinderUnicodeTest-2054414383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e1beb885-9518-48f4-976c-80a9fb7ec2fe" returned: 0 in 0.351s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:06 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7d516b28-4e02-4375-82a8-e27d4855454a tempest-SnapshotMetadataTestJSON-1071113656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.85971827-eaf6-4f41-ac08-d616c724ae00" returned: 0 in 0.472s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-7d516b28-4e02-4375-82a8-e27d4855454a tempest-SnapshotMetadataTestJSON-1071113656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36a27f8d-989f-4a26-9c19-dad08b34b02c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-45c1854c-b012-477c-8689-d1d5029c8a2e tempest-CinderUnicodeTest-2054414383 None] Lock "cinder-quobyte-e1beb885-9518-48f4-976c-80a9fb7ec2fe" released by "delete_volume" :: held 0.990s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ec11e5-0716-403d-9eee-0473c7326f88]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7d516b28-4e02-4375-82a8-e27d4855454a tempest-SnapshotMetadataTestJSON-1071113656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-45c1854c-b012-477c-8689-d1d5029c8a2e tempest-CinderUnicodeTest-2054414383 None] Created reservations ['d5b46c27-2a11-4ebe-bf41-3a6d472c61ed', '5b8661da-ca95-4c56-9456-82ad3d3afaa7', '5eb1f9b0-0dbf-4235-acd0-fe499b98e0d9', 'cf9f3139-1b44-42b7-a824-0240aa22b87b'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:59:07 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-489d6ac4-3609-4405-a3b2-41db0a96cc5f" returned: 0 in 0.305s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:07 devstack sudo[99906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c
Sep 04 15:59:07 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7c409f79-5977-4e74-a869-582316d90c6d tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.444s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d22ea1-8f9b-4167-ad10-dbdcff3dcb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-489d6ac4-3609-4405-a3b2-41db0a96cc5f', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9e7223-92db-4694-b3b3-f8d7e01c4a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-7c409f79-5977-4e74-a869-582316d90c6d tempest-VolumesSnapshotTestJSON-1945023076 None] Creating offline snapshot e7b3a897-e168-4f1a-ab7a-cb41143fdf13 of volume 008d2f8f-e712-4cbc-bf74-f15c040a88e7 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e8853b-f470-4250-b6a2-5f01e98c1a08]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7c409f79-5977-4e74-a869-582316d90c6d tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:07 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Volume volume-489d6ac4-3609-4405-a3b2-41db0a96cc5f (489d6ac4-3609-4405-a3b2-41db0a96cc5f): created successfully
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9e7223-92db-4694-b3b3-f8d7e01c4a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Flow 'volume_create_manager' (236f9ef8-bed7-4d5e-9765-592ef1cf3f0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-45c1854c-b012-477c-8689-d1d5029c8a2e tempest-CinderUnicodeTest-2054414383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-45c1854c-b012-477c-8689-d1d5029c8a2e tempest-CinderUnicodeTest-2054414383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-45c1854c-b012-477c-8689-d1d5029c8a2e tempest-CinderUnicodeTest-2054414383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-45c1854c-b012-477c-8689-d1d5029c8a2e tempest-CinderUnicodeTest-2054414383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-45c1854c-b012-477c-8689-d1d5029c8a2e tempest-CinderUnicodeTest-2054414383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-45c1854c-b012-477c-8689-d1d5029c8a2e tempest-CinderUnicodeTest-2054414383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:07 devstack sudo[99910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:59:07 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:07 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-3a6aa3da-bf37-49a2-acb4-f80317cc588a tempest-VolumesListAdminTestJSON-87288527 None] Created volume successfully.
Sep 04 15:59:07 devstack sudo[99909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7
Sep 04 15:59:07 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:07 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7d516b28-4e02-4375-82a8-e27d4855454a tempest-SnapshotMetadataTestJSON-1071113656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c" returned: 0 in 0.445s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7d516b28-4e02-4375-82a8-e27d4855454a tempest-SnapshotMetadataTestJSON-1071113656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.85971827-eaf6-4f41-ac08-d616c724ae00 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:07 devstack sudo[99917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.85971827-eaf6-4f41-ac08-d616c724ae00
Sep 04 15:59:07 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:07 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-45c1854c-b012-477c-8689-d1d5029c8a2e tempest-CinderUnicodeTest-2054414383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.351s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-45c1854c-b012-477c-8689-d1d5029c8a2e tempest-CinderUnicodeTest-2054414383 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:59:07 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-45c1854c-b012-477c-8689-d1d5029c8a2e tempest-CinderUnicodeTest-2054414383 None] Deleted volume successfully.
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-45c1854c-b012-477c-8689-d1d5029c8a2e tempest-CinderUnicodeTest-2054414383 None] Lock "cinder-e1beb885-9518-48f4-976c-80a9fb7ec2fe-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:07 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7c409f79-5977-4e74-a869-582316d90c6d tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7" returned: 0 in 0.503s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7c409f79-5977-4e74-a869-582316d90c6d tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.e7b3a897-e168-4f1a-ab7a-cb41143fdf13 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:07 devstack sudo[99923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.e7b3a897-e168-4f1a-ab7a-cb41143fdf13 1G
Sep 04 15:59:07 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ed8a5d59-b995-473d-9edc-85c664e6fd66 tempest-VolumesListAdminTestJSON-87288527 None] Acquiring lock "cinder-489d6ac4-3609-4405-a3b2-41db0a96cc5f-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ed8a5d59-b995-473d-9edc-85c664e6fd66 tempest-VolumesListAdminTestJSON-87288527 None] Lock "cinder-489d6ac4-3609-4405-a3b2-41db0a96cc5f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ed8a5d59-b995-473d-9edc-85c664e6fd66 tempest-VolumesListAdminTestJSON-87288527 None] Acquiring lock "cinder-quobyte-489d6ac4-3609-4405-a3b2-41db0a96cc5f" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ed8a5d59-b995-473d-9edc-85c664e6fd66 tempest-VolumesListAdminTestJSON-87288527 None] Lock "cinder-quobyte-489d6ac4-3609-4405-a3b2-41db0a96cc5f" acquired by "delete_volume" :: waited 0.030s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5862d3-ab82-43de-a507-1191e3df71bb]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ed8a5d59-b995-473d-9edc-85c664e6fd66 tempest-VolumesListAdminTestJSON-87288527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-489d6ac4-3609-4405-a3b2-41db0a96cc5f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8963f69b-ea7b-46b1-a7ba-b65b256c5872 tempest-VolumesListAdminTestJSON-1186074805 None] Acquiring lock "cinder-bc145226-5671-421d-a5e7-b52253ed669f-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8963f69b-ea7b-46b1-a7ba-b65b256c5872 tempest-VolumesListAdminTestJSON-1186074805 None] Lock "cinder-bc145226-5671-421d-a5e7-b52253ed669f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:07 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7d516b28-4e02-4375-82a8-e27d4855454a tempest-SnapshotMetadataTestJSON-1071113656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.85971827-eaf6-4f41-ac08-d616c724ae00" returned: 0 in 0.577s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7d516b28-4e02-4375-82a8-e27d4855454a tempest-SnapshotMetadataTestJSON-1071113656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.85971827-eaf6-4f41-ac08-d616c724ae00 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:07 devstack sudo[99931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.85971827-eaf6-4f41-ac08-d616c724ae00
Sep 04 15:59:07 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8963f69b-ea7b-46b1-a7ba-b65b256c5872 tempest-VolumesListAdminTestJSON-1186074805 None] Acquiring lock "cinder-quobyte-bc145226-5671-421d-a5e7-b52253ed669f" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:08 devstack sudo[99928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-489d6ac4-3609-4405-a3b2-41db0a96cc5f
Sep 04 15:59:08 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8963f69b-ea7b-46b1-a7ba-b65b256c5872 tempest-VolumesListAdminTestJSON-1186074805 None] Lock "cinder-quobyte-bc145226-5671-421d-a5e7-b52253ed669f" acquired by "delete_volume" :: waited 0.030s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c848a2-7969-47e1-812b-dd0196946de7]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8963f69b-ea7b-46b1-a7ba-b65b256c5872 tempest-VolumesListAdminTestJSON-1186074805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bc145226-5671-421d-a5e7-b52253ed669f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f8c39693-0ae2-419d-8ed4-5b988a44cbe7 tempest-CinderUnicodeTest-2054414383 None] Acquiring lock "cinder-9ada7eeb-9647-4a7d-995a-129050d528f7-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f8c39693-0ae2-419d-8ed4-5b988a44cbe7 tempest-CinderUnicodeTest-2054414383 None] Lock "cinder-9ada7eeb-9647-4a7d-995a-129050d528f7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:08 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f8c39693-0ae2-419d-8ed4-5b988a44cbe7 tempest-CinderUnicodeTest-2054414383 None] Acquiring lock "cinder-quobyte-9ada7eeb-9647-4a7d-995a-129050d528f7" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:08 devstack sudo[99935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bc145226-5671-421d-a5e7-b52253ed669f
Sep 04 15:59:08 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7c409f79-5977-4e74-a869-582316d90c6d tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.e7b3a897-e168-4f1a-ab7a-cb41143fdf13 1G" returned: 0 in 0.674s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7c409f79-5977-4e74-a869-582316d90c6d tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.e7b3a897-e168-4f1a-ab7a-cb41143fdf13 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f8c39693-0ae2-419d-8ed4-5b988a44cbe7 tempest-CinderUnicodeTest-2054414383 None] Lock "cinder-quobyte-9ada7eeb-9647-4a7d-995a-129050d528f7" acquired by "delete_volume" :: waited 0.047s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:08 devstack sudo[99938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.e7b3a897-e168-4f1a-ab7a-cb41143fdf13
Sep 04 15:59:08 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:08 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7d516b28-4e02-4375-82a8-e27d4855454a tempest-SnapshotMetadataTestJSON-1071113656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c.85971827-eaf6-4f41-ac08-d616c724ae00" returned: 0 in 0.433s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b05178a-e281-4e1b-b44c-09d7cb9850c7]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f8c39693-0ae2-419d-8ed4-5b988a44cbe7 tempest-CinderUnicodeTest-2054414383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ada7eeb-9647-4a7d-995a-129050d528f7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:08 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ed8a5d59-b995-473d-9edc-85c664e6fd66 tempest-VolumesListAdminTestJSON-87288527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-489d6ac4-3609-4405-a3b2-41db0a96cc5f" returned: 0 in 0.638s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ed8a5d59-b995-473d-9edc-85c664e6fd66 tempest-VolumesListAdminTestJSON-87288527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-489d6ac4-3609-4405-a3b2-41db0a96cc5f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7d516b28-4e02-4375-82a8-e27d4855454a tempest-SnapshotMetadataTestJSON-1071113656 None] Lock "cinder-quobyte-85971827-eaf6-4f41-ac08-d616c724ae00" released by "_delete_snapshot" :: held 2.138s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7d516b28-4e02-4375-82a8-e27d4855454a tempest-SnapshotMetadataTestJSON-1071113656 None] Lock "cinder-quobyte-36a27f8d-989f-4a26-9c19-dad08b34b02c" released by "delete_snapshot" :: held 2.177s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:08 devstack sudo[99944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-489d6ac4-3609-4405-a3b2-41db0a96cc5f
Sep 04 15:59:08 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:08 devstack sudo[99943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ada7eeb-9647-4a7d-995a-129050d528f7
Sep 04 15:59:08 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-7d516b28-4e02-4375-82a8-e27d4855454a tempest-SnapshotMetadataTestJSON-1071113656 None] Created reservations ['87a8f5ce-11cc-41e5-b820-17fa2d0d121a', '354e6644-4f9a-4b91-9df4-958436428e71', 'e83671c7-17ff-4265-b227-5ae498a6003a', '80e7397d-e561-4fb4-a5e1-0006b55c9781'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:59:08 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8963f69b-ea7b-46b1-a7ba-b65b256c5872 tempest-VolumesListAdminTestJSON-1186074805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bc145226-5671-421d-a5e7-b52253ed669f" returned: 0 in 0.626s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8963f69b-ea7b-46b1-a7ba-b65b256c5872 tempest-VolumesListAdminTestJSON-1186074805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bc145226-5671-421d-a5e7-b52253ed669f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:08 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-7d516b28-4e02-4375-82a8-e27d4855454a tempest-SnapshotMetadataTestJSON-1071113656 None] Delete snapshot completed successfully.
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7d516b28-4e02-4375-82a8-e27d4855454a tempest-SnapshotMetadataTestJSON-1071113656 None] Lock "cinder-85971827-eaf6-4f41-ac08-d616c724ae00-delete_snapshot" released by "delete_snapshot" :: held 2.433s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:08 devstack sudo[99953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bc145226-5671-421d-a5e7-b52253ed669f
Sep 04 15:59:08 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:08 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7c409f79-5977-4e74-a869-582316d90c6d tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.e7b3a897-e168-4f1a-ab7a-cb41143fdf13" returned: 0 in 0.464s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:08 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-7c409f79-5977-4e74-a869-582316d90c6d tempest-VolumesSnapshotTestJSON-1945023076 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.e7b3a897-e168-4f1a-ab7a-cb41143fdf13 is being set with open permissions: ugo+rw
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7c409f79-5977-4e74-a869-582316d90c6d tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.e7b3a897-e168-4f1a-ab7a-cb41143fdf13 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:08 devstack sudo[99955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.e7b3a897-e168-4f1a-ab7a-cb41143fdf13
Sep 04 15:59:08 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:08 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ed8a5d59-b995-473d-9edc-85c664e6fd66 tempest-VolumesListAdminTestJSON-87288527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-489d6ac4-3609-4405-a3b2-41db0a96cc5f" returned: 0 in 0.406s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ed8a5d59-b995-473d-9edc-85c664e6fd66 tempest-VolumesListAdminTestJSON-87288527 None] Lock "cinder-quobyte-489d6ac4-3609-4405-a3b2-41db0a96cc5f" released by "delete_volume" :: held 1.100s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:08 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-ed8a5d59-b995-473d-9edc-85c664e6fd66 tempest-VolumesListAdminTestJSON-87288527 None] Created reservations ['6f7e09d4-6a65-46ba-916d-66a37dfd8431', '64e17391-7d61-470b-8195-bfa3a3c4beef', '31e33bba-03cf-41eb-87bd-cc51f7c053fa', 'fe5635c1-e11d-451a-9a9d-14e5cce1ee30'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f8c39693-0ae2-419d-8ed4-5b988a44cbe7 tempest-CinderUnicodeTest-2054414383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ada7eeb-9647-4a7d-995a-129050d528f7" returned: 0 in 0.574s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f8c39693-0ae2-419d-8ed4-5b988a44cbe7 tempest-CinderUnicodeTest-2054414383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ada7eeb-9647-4a7d-995a-129050d528f7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:09 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8963f69b-ea7b-46b1-a7ba-b65b256c5872 tempest-VolumesListAdminTestJSON-1186074805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bc145226-5671-421d-a5e7-b52253ed669f" returned: 0 in 0.317s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:09 devstack sudo[99962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ada7eeb-9647-4a7d-995a-129050d528f7
Sep 04 15:59:09 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8963f69b-ea7b-46b1-a7ba-b65b256c5872 tempest-VolumesListAdminTestJSON-1186074805 None] Lock "cinder-quobyte-bc145226-5671-421d-a5e7-b52253ed669f" released by "delete_volume" :: held 1.000s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:09 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7c409f79-5977-4e74-a869-582316d90c6d tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.e7b3a897-e168-4f1a-ab7a-cb41143fdf13" returned: 0 in 0.319s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ed8a5d59-b995-473d-9edc-85c664e6fd66 tempest-VolumesListAdminTestJSON-87288527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ed8a5d59-b995-473d-9edc-85c664e6fd66 tempest-VolumesListAdminTestJSON-87288527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ed8a5d59-b995-473d-9edc-85c664e6fd66 tempest-VolumesListAdminTestJSON-87288527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ed8a5d59-b995-473d-9edc-85c664e6fd66 tempest-VolumesListAdminTestJSON-87288527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ed8a5d59-b995-473d-9edc-85c664e6fd66 tempest-VolumesListAdminTestJSON-87288527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ed8a5d59-b995-473d-9edc-85c664e6fd66 tempest-VolumesListAdminTestJSON-87288527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:09 devstack sudo[99965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:59:09 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7c409f79-5977-4e74-a869-582316d90c6d tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-8963f69b-ea7b-46b1-a7ba-b65b256c5872 tempest-VolumesListAdminTestJSON-1186074805 None] Created reservations ['a1de252d-4e0e-406a-8a10-e431f57e761d', '9fe9d4b9-3720-4816-8141-3e343d258d44', '212c49c1-5a27-41cc-a7a8-1e6392fdcada', '2928576b-d0e5-49d1-9ed1-53888b423056'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:59:09 devstack sudo[99967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.info
Sep 04 15:59:09 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-8963f69b-ea7b-46b1-a7ba-b65b256c5872 tempest-VolumesListAdminTestJSON-1186074805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-8963f69b-ea7b-46b1-a7ba-b65b256c5872 tempest-VolumesListAdminTestJSON-1186074805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-8963f69b-ea7b-46b1-a7ba-b65b256c5872 tempest-VolumesListAdminTestJSON-1186074805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-8963f69b-ea7b-46b1-a7ba-b65b256c5872 tempest-VolumesListAdminTestJSON-1186074805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-8963f69b-ea7b-46b1-a7ba-b65b256c5872 tempest-VolumesListAdminTestJSON-1186074805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8963f69b-ea7b-46b1-a7ba-b65b256c5872 tempest-VolumesListAdminTestJSON-1186074805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:09 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f8c39693-0ae2-419d-8ed4-5b988a44cbe7 tempest-CinderUnicodeTest-2054414383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ada7eeb-9647-4a7d-995a-129050d528f7" returned: 0 in 0.379s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:09 devstack sudo[99970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:59:09 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f8c39693-0ae2-419d-8ed4-5b988a44cbe7 tempest-CinderUnicodeTest-2054414383 None] Lock "cinder-quobyte-9ada7eeb-9647-4a7d-995a-129050d528f7" released by "delete_volume" :: held 1.046s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:09 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ed8a5d59-b995-473d-9edc-85c664e6fd66 tempest-VolumesListAdminTestJSON-87288527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.335s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ed8a5d59-b995-473d-9edc-85c664e6fd66 tempest-VolumesListAdminTestJSON-87288527 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:59:09 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-ed8a5d59-b995-473d-9edc-85c664e6fd66 tempest-VolumesListAdminTestJSON-87288527 None] Deleted volume successfully.
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-f8c39693-0ae2-419d-8ed4-5b988a44cbe7 tempest-CinderUnicodeTest-2054414383 None] Created reservations ['6d12fa48-9640-4070-bec3-5b29cc40e2a8', '35a89326-4651-4317-bf69-45c2e02325a6', '3cabceaa-4650-478d-8680-65ecff44ef68', '2f7d1bed-b51a-4e29-a0c5-ea75b75ac75c'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:59:09 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7c409f79-5977-4e74-a869-582316d90c6d tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.info" returned: 0 in 0.338s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:09 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-7c409f79-5977-4e74-a869-582316d90c6d tempest-VolumesSnapshotTestJSON-1945023076 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.info is being set with open permissions: ugo+rw
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7c409f79-5977-4e74-a869-582316d90c6d tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ed8a5d59-b995-473d-9edc-85c664e6fd66 tempest-VolumesListAdminTestJSON-87288527 None] Lock "cinder-489d6ac4-3609-4405-a3b2-41db0a96cc5f-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:09 devstack sudo[99974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.info
Sep 04 15:59:09 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f8c39693-0ae2-419d-8ed4-5b988a44cbe7 tempest-CinderUnicodeTest-2054414383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f8c39693-0ae2-419d-8ed4-5b988a44cbe7 tempest-CinderUnicodeTest-2054414383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f8c39693-0ae2-419d-8ed4-5b988a44cbe7 tempest-CinderUnicodeTest-2054414383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f8c39693-0ae2-419d-8ed4-5b988a44cbe7 tempest-CinderUnicodeTest-2054414383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f8c39693-0ae2-419d-8ed4-5b988a44cbe7 tempest-CinderUnicodeTest-2054414383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f8c39693-0ae2-419d-8ed4-5b988a44cbe7 tempest-CinderUnicodeTest-2054414383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fb3fe4f7-298e-4489-98e4-e782fc143ea0 tempest-SnapshotMetadataTestJSON-1071113656 None] Acquiring lock "cinder-36a27f8d-989f-4a26-9c19-dad08b34b02c-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:09 devstack sudo[99976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:59:09 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fb3fe4f7-298e-4489-98e4-e782fc143ea0 tempest-SnapshotMetadataTestJSON-1071113656 None] Lock "cinder-36a27f8d-989f-4a26-9c19-dad08b34b02c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fb3fe4f7-298e-4489-98e4-e782fc143ea0 tempest-SnapshotMetadataTestJSON-1071113656 None] Acquiring lock "cinder-quobyte-36a27f8d-989f-4a26-9c19-dad08b34b02c" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fb3fe4f7-298e-4489-98e4-e782fc143ea0 tempest-SnapshotMetadataTestJSON-1071113656 None] Lock "cinder-quobyte-36a27f8d-989f-4a26-9c19-dad08b34b02c" acquired by "delete_volume" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:09 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8963f69b-ea7b-46b1-a7ba-b65b256c5872 tempest-VolumesListAdminTestJSON-1186074805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.531s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-8963f69b-ea7b-46b1-a7ba-b65b256c5872 tempest-VolumesListAdminTestJSON-1186074805 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:59:09 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-8963f69b-ea7b-46b1-a7ba-b65b256c5872 tempest-VolumesListAdminTestJSON-1186074805 None] Deleted volume successfully.
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dce56b0-8e54-4f1b-a37d-541a26f2489b]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb3fe4f7-298e-4489-98e4-e782fc143ea0 tempest-SnapshotMetadataTestJSON-1071113656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:09 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7c409f79-5977-4e74-a869-582316d90c6d tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.info" returned: 0 in 0.375s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7c409f79-5977-4e74-a869-582316d90c6d tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.841s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:09 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8963f69b-ea7b-46b1-a7ba-b65b256c5872 tempest-VolumesListAdminTestJSON-1186074805 None] Lock "cinder-bc145226-5671-421d-a5e7-b52253ed669f-delete_volume" released by "delete_volume" :: held 2.013s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:09 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-7c409f79-5977-4e74-a869-582316d90c6d tempest-VolumesSnapshotTestJSON-1945023076 None] Create snapshot completed successfully
Sep 04 15:59:10 devstack sudo[99980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c
Sep 04 15:59:10 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:10 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f8c39693-0ae2-419d-8ed4-5b988a44cbe7 tempest-CinderUnicodeTest-2054414383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.400s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:10 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-f8c39693-0ae2-419d-8ed4-5b988a44cbe7 tempest-CinderUnicodeTest-2054414383 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:59:10 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f8c39693-0ae2-419d-8ed4-5b988a44cbe7 tempest-CinderUnicodeTest-2054414383 None] Deleted volume successfully.
Sep 04 15:59:10 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f8c39693-0ae2-419d-8ed4-5b988a44cbe7 tempest-CinderUnicodeTest-2054414383 None] Lock "cinder-9ada7eeb-9647-4a7d-995a-129050d528f7-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:10 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ac213810-f2db-4bf7-a3f9-aa0e4576d2d6 tempest-VolumesListAdminTestJSON-1186074805 None] Acquiring lock "cinder-bcfec116-947a-4017-856d-86fcfb4be41a-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:10 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ac213810-f2db-4bf7-a3f9-aa0e4576d2d6 tempest-VolumesListAdminTestJSON-1186074805 None] Lock "cinder-bcfec116-947a-4017-856d-86fcfb4be41a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:10 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ac213810-f2db-4bf7-a3f9-aa0e4576d2d6 tempest-VolumesListAdminTestJSON-1186074805 None] Acquiring lock "cinder-quobyte-bcfec116-947a-4017-856d-86fcfb4be41a" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:10 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb3fe4f7-298e-4489-98e4-e782fc143ea0 tempest-SnapshotMetadataTestJSON-1071113656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c" returned: 0 in 0.439s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb3fe4f7-298e-4489-98e4-e782fc143ea0 tempest-SnapshotMetadataTestJSON-1071113656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:10 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ac213810-f2db-4bf7-a3f9-aa0e4576d2d6 tempest-VolumesListAdminTestJSON-1186074805 None] Lock "cinder-quobyte-bcfec116-947a-4017-856d-86fcfb4be41a" acquired by "delete_volume" :: waited 0.033s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:10 devstack sudo[99987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c
Sep 04 15:59:10 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:10 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c5ee69-d76d-479c-b122-6051e370ef29]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ac213810-f2db-4bf7-a3f9-aa0e4576d2d6 tempest-VolumesListAdminTestJSON-1186074805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bcfec116-947a-4017-856d-86fcfb4be41a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:10 devstack sudo[99989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bcfec116-947a-4017-856d-86fcfb4be41a
Sep 04 15:59:10 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:10 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb3fe4f7-298e-4489-98e4-e782fc143ea0 tempest-SnapshotMetadataTestJSON-1071113656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-36a27f8d-989f-4a26-9c19-dad08b34b02c" returned: 0 in 0.302s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:10 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fb3fe4f7-298e-4489-98e4-e782fc143ea0 tempest-SnapshotMetadataTestJSON-1071113656 None] Lock "cinder-quobyte-36a27f8d-989f-4a26-9c19-dad08b34b02c" released by "delete_volume" :: held 0.835s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:10 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-fb3fe4f7-298e-4489-98e4-e782fc143ea0 tempest-SnapshotMetadataTestJSON-1071113656 None] Created reservations ['a4a00110-b882-438a-a810-8cffa2ed3e16', '0f718478-6338-45ba-b710-4a8d4f3d6aab', '43d9a528-1e88-4b19-81a8-9a815e6b07a5', 'e59b6775-97a5-4ee1-afb1-b66f12702752'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:59:10 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ac213810-f2db-4bf7-a3f9-aa0e4576d2d6 tempest-VolumesListAdminTestJSON-1186074805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bcfec116-947a-4017-856d-86fcfb4be41a" returned: 0 in 0.419s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ac213810-f2db-4bf7-a3f9-aa0e4576d2d6 tempest-VolumesListAdminTestJSON-1186074805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bcfec116-947a-4017-856d-86fcfb4be41a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fb3fe4f7-298e-4489-98e4-e782fc143ea0 tempest-SnapshotMetadataTestJSON-1071113656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fb3fe4f7-298e-4489-98e4-e782fc143ea0 tempest-SnapshotMetadataTestJSON-1071113656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:10 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-fb3fe4f7-298e-4489-98e4-e782fc143ea0 tempest-SnapshotMetadataTestJSON-1071113656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:10 devstack sudo[99995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bcfec116-947a-4017-856d-86fcfb4be41a
Sep 04 15:59:10 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-fb3fe4f7-298e-4489-98e4-e782fc143ea0 tempest-SnapshotMetadataTestJSON-1071113656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fb3fe4f7-298e-4489-98e4-e782fc143ea0 tempest-SnapshotMetadataTestJSON-1071113656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb3fe4f7-298e-4489-98e4-e782fc143ea0 tempest-SnapshotMetadataTestJSON-1071113656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:10 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:10 devstack sudo[99997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:59:10 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:11 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ac213810-f2db-4bf7-a3f9-aa0e4576d2d6 tempest-VolumesListAdminTestJSON-1186074805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bcfec116-947a-4017-856d-86fcfb4be41a" returned: 0 in 0.370s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:11 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb3fe4f7-298e-4489-98e4-e782fc143ea0 tempest-SnapshotMetadataTestJSON-1071113656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.350s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-fb3fe4f7-298e-4489-98e4-e782fc143ea0 tempest-SnapshotMetadataTestJSON-1071113656 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ac213810-f2db-4bf7-a3f9-aa0e4576d2d6 tempest-VolumesListAdminTestJSON-1186074805 None] Lock "cinder-quobyte-bcfec116-947a-4017-856d-86fcfb4be41a" released by "delete_volume" :: held 0.861s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:11 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-fb3fe4f7-298e-4489-98e4-e782fc143ea0 tempest-SnapshotMetadataTestJSON-1071113656 None] Deleted volume successfully.
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fb3fe4f7-298e-4489-98e4-e782fc143ea0 tempest-SnapshotMetadataTestJSON-1071113656 None] Lock "cinder-36a27f8d-989f-4a26-9c19-dad08b34b02c-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-ac213810-f2db-4bf7-a3f9-aa0e4576d2d6 tempest-VolumesListAdminTestJSON-1186074805 None] Created reservations ['783accee-4f8a-4f01-a1cd-9327a088653f', '08401ec6-dfaa-42eb-9045-9a16fe3742f4', '85e4b982-473b-4a1b-b4e1-cb254b4cf700', 'f2bb4f19-c307-4e08-b225-9f6655e82391'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ac213810-f2db-4bf7-a3f9-aa0e4576d2d6 tempest-VolumesListAdminTestJSON-1186074805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ac213810-f2db-4bf7-a3f9-aa0e4576d2d6 tempest-VolumesListAdminTestJSON-1186074805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ac213810-f2db-4bf7-a3f9-aa0e4576d2d6 tempest-VolumesListAdminTestJSON-1186074805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ac213810-f2db-4bf7-a3f9-aa0e4576d2d6 tempest-VolumesListAdminTestJSON-1186074805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ac213810-f2db-4bf7-a3f9-aa0e4576d2d6 tempest-VolumesListAdminTestJSON-1186074805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ac213810-f2db-4bf7-a3f9-aa0e4576d2d6 tempest-VolumesListAdminTestJSON-1186074805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:11 devstack sudo[100001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:59:11 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2cd71157-9ee9-4a9e-b2d1-edc185aefe0a tempest-VolumesListAdminTestJSON-1186074805 None] Acquiring lock "cinder-1e855710-95c0-4a18-9949-4b652fe0025e-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2cd71157-9ee9-4a9e-b2d1-edc185aefe0a tempest-VolumesListAdminTestJSON-1186074805 None] Lock "cinder-1e855710-95c0-4a18-9949-4b652fe0025e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2cd71157-9ee9-4a9e-b2d1-edc185aefe0a tempest-VolumesListAdminTestJSON-1186074805 None] Acquiring lock "cinder-quobyte-1e855710-95c0-4a18-9949-4b652fe0025e" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2cd71157-9ee9-4a9e-b2d1-edc185aefe0a tempest-VolumesListAdminTestJSON-1186074805 None] Lock "cinder-quobyte-1e855710-95c0-4a18-9949-4b652fe0025e" acquired by "delete_volume" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:11 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae07d80-189e-4492-84a8-c43c303b7900]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2cd71157-9ee9-4a9e-b2d1-edc185aefe0a tempest-VolumesListAdminTestJSON-1186074805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1e855710-95c0-4a18-9949-4b652fe0025e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ac213810-f2db-4bf7-a3f9-aa0e4576d2d6 tempest-VolumesListAdminTestJSON-1186074805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.420s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ac213810-f2db-4bf7-a3f9-aa0e4576d2d6 tempest-VolumesListAdminTestJSON-1186074805 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:59:11 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-ac213810-f2db-4bf7-a3f9-aa0e4576d2d6 tempest-VolumesListAdminTestJSON-1186074805 None] Deleted volume successfully.
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ac213810-f2db-4bf7-a3f9-aa0e4576d2d6 tempest-VolumesListAdminTestJSON-1186074805 None] Lock "cinder-bcfec116-947a-4017-856d-86fcfb4be41a-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Flow 'volume_create_manager' (a1ec1eb0-97bb-4335-969f-c32c0cb8630e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc94e8f-ed4f-44c9-86a2-ebe8f714867f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc94e8f-ed4f-44c9-86a2-ebe8f714867f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1227342026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f8be6b-4379-4004-806d-1f48b42d8482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a7f9e6404314a50af699cb79d79e676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e7b3a897-e168-4f1a-ab7a-cb41143fdf13,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:12Z,use_quota=True,user_id='32f390736f114e0c942690ded0dff859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd4695be-56f5-4f39-a23d-f6fc2fa3b5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd4695be-56f5-4f39-a23d-f6fc2fa3b5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:11 devstack sudo[100004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1e855710-95c0-4a18-9949-4b652fe0025e
Sep 04 15:59:11 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ab6850-d05e-490c-aab4-04f6a15fdf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ab6850-d05e-490c-aab4-04f6a15fdf0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '17f8be6b-4379-4004-806d-1f48b42d8482', 'volume_name': 'volume-17f8be6b-4379-4004-806d-1f48b42d8482', 'volume_size': 1, 'snapshot_id': 'e7b3a897-e168-4f1a-ab7a-cb41143fdf13'}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78608b8-406a-4a6d-97a2-8101e830564d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78608b8-406a-4a6d-97a2-8101e830564d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c5ba92-d2ed-4286-881e-22ca83df0417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:12 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Volume 17f8be6b-4379-4004-806d-1f48b42d8482: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-17f8be6b-4379-4004-806d-1f48b42d8482', 'volume_size': 1, 'snapshot_id': 'e7b3a897-e168-4f1a-ab7a-cb41143fdf13'}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "cinder-quobyte-e7b3a897-e168-4f1a-ab7a-cb41143fdf13-17f8be6b-4379-4004-806d-1f48b42d8482" by "_create_volume_from_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-e7b3a897-e168-4f1a-ab7a-cb41143fdf13-17f8be6b-4379-4004-806d-1f48b42d8482" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Creating volume 17f8be6b-4379-4004-806d-1f48b42d8482 from snapshot e7b3a897-e168-4f1a-ab7a-cb41143fdf13 {{(pid=87504) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "cinder-quobyte-17f8be6b-4379-4004-806d-1f48b42d8482" by "_copy_volume_from_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-17f8be6b-4379-4004-806d-1f48b42d8482" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] snapshot: e7b3a897-e168-4f1a-ab7a-cb41143fdf13, volume: 17f8be6b-4379-4004-806d-1f48b42d8482,  {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[990e45aa-c701-4948-b001-64ff73b2b569]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.e7b3a897-e168-4f1a-ab7a-cb41143fdf13 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:12 devstack sudo[100006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.e7b3a897-e168-4f1a-ab7a-cb41143fdf13
Sep 04 15:59:12 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:12 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2cd71157-9ee9-4a9e-b2d1-edc185aefe0a tempest-VolumesListAdminTestJSON-1186074805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1e855710-95c0-4a18-9949-4b652fe0025e" returned: 0 in 0.562s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2cd71157-9ee9-4a9e-b2d1-edc185aefe0a tempest-VolumesListAdminTestJSON-1186074805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1e855710-95c0-4a18-9949-4b652fe0025e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:12 devstack sudo[100012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1e855710-95c0-4a18-9949-4b652fe0025e
Sep 04 15:59:12 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:12 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.e7b3a897-e168-4f1a-ab7a-cb41143fdf13" returned: 0 in 0.475s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b62c02-ae8f-439e-8d73-7afacf348a2a]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:12 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2cd71157-9ee9-4a9e-b2d1-edc185aefe0a tempest-VolumesListAdminTestJSON-1186074805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1e855710-95c0-4a18-9949-4b652fe0025e" returned: 0 in 0.335s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2cd71157-9ee9-4a9e-b2d1-edc185aefe0a tempest-VolumesListAdminTestJSON-1186074805 None] Lock "cinder-quobyte-1e855710-95c0-4a18-9949-4b652fe0025e" released by "delete_volume" :: held 0.975s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:12 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-2cd71157-9ee9-4a9e-b2d1-edc185aefe0a tempest-VolumesListAdminTestJSON-1186074805 None] Created reservations ['99419cf5-ca55-45a5-9908-cdbe7d0708ed', 'bfe0daa7-829f-4682-870c-81e4f97e0d68', '6b550198-946a-4310-8bff-04971575483a', '99d53595-e410-4f1c-993f-ca945929ea54'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:59:12 devstack sudo[100018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7
Sep 04 15:59:12 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2cd71157-9ee9-4a9e-b2d1-edc185aefe0a tempest-VolumesListAdminTestJSON-1186074805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2cd71157-9ee9-4a9e-b2d1-edc185aefe0a tempest-VolumesListAdminTestJSON-1186074805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2cd71157-9ee9-4a9e-b2d1-edc185aefe0a tempest-VolumesListAdminTestJSON-1186074805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2cd71157-9ee9-4a9e-b2d1-edc185aefe0a tempest-VolumesListAdminTestJSON-1186074805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2cd71157-9ee9-4a9e-b2d1-edc185aefe0a tempest-VolumesListAdminTestJSON-1186074805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2cd71157-9ee9-4a9e-b2d1-edc185aefe0a tempest-VolumesListAdminTestJSON-1186074805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:13 devstack sudo[100020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:59:13 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:13 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7" returned: 0 in 0.509s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7 {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 04 15:59:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Creating direct copy from snapshot {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 04 15:59:13 devstack cinder-volume[87504]: DEBUG cinder.utils [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Path /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-17f8be6b-4379-4004-806d-1f48b42d8482 not found in is_blk_device check {{(pid=87504) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 04 15:59:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-17f8be6b-4379-4004-806d-1f48b42d8482 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:13 devstack sudo[100026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-17f8be6b-4379-4004-806d-1f48b42d8482
Sep 04 15:59:13 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:13 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2cd71157-9ee9-4a9e-b2d1-edc185aefe0a tempest-VolumesListAdminTestJSON-1186074805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.306s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:13 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-2cd71157-9ee9-4a9e-b2d1-edc185aefe0a tempest-VolumesListAdminTestJSON-1186074805 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:59:13 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-2cd71157-9ee9-4a9e-b2d1-edc185aefe0a tempest-VolumesListAdminTestJSON-1186074805 None] Deleted volume successfully.
Sep 04 15:59:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2cd71157-9ee9-4a9e-b2d1-edc185aefe0a tempest-VolumesListAdminTestJSON-1186074805 None] Lock "cinder-1e855710-95c0-4a18-9949-4b652fe0025e-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:18 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-17f8be6b-4379-4004-806d-1f48b42d8482" returned: 0 in 5.695s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:18 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-17f8be6b-4379-4004-806d-1f48b42d8482 {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 15:59:18 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Converted 1024.00 MB image at 179.79 MB/s
Sep 04 15:59:18 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-17f8be6b-4379-4004-806d-1f48b42d8482 is being set with open permissions: ugo+rw
Sep 04 15:59:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-17f8be6b-4379-4004-806d-1f48b42d8482 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:18 devstack sudo[100041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-17f8be6b-4379-4004-806d-1f48b42d8482
Sep 04 15:59:18 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Flow 'volume_create_manager' (ec999443-68cd-4a24-97d5-bac38de080b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a6ad41-4961-4399-a9b3-0088b9b0b6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:19 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a6ad41-4961-4399-a9b3-0088b9b0b6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1552040067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce70d5f6-d054-47ab-a2a2-0f11987dc190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c6969d75fa4c068a77fa2a148c2979',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:19Z,use_quota=True,user_id='11f93da40c7648dd9fc82d108b9c35c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef75b5e-99b2-4ced-ab20-993a49086ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef75b5e-99b2-4ced-ab20-993a49086ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97199326-33c6-40ae-b50a-3432a3eae25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97199326-33c6-40ae-b50a-3432a3eae25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce70d5f6-d054-47ab-a2a2-0f11987dc190', 'volume_name': 'volume-ce70d5f6-d054-47ab-a2a2-0f11987dc190', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ebb1751-7e6f-485f-a9a6-7fe04fd33153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ebb1751-7e6f-485f-a9a6-7fe04fd33153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee28bd1f-1d04-4d11-953a-472c32595d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:19 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Volume ce70d5f6-d054-47ab-a2a2-0f11987dc190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce70d5f6-d054-47ab-a2a2-0f11987dc190', 'volume_size': 1}
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-17f8be6b-4379-4004-806d-1f48b42d8482" returned: 0 in 0.440s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-17f8be6b-4379-4004-806d-1f48b42d8482" released by "_copy_volume_from_snapshot" :: held 7.263s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-e7b3a897-e168-4f1a-ab7a-cb41143fdf13-17f8be6b-4379-4004-806d-1f48b42d8482" released by "_create_volume_from_snapshot" :: held 7.357s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.394s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.072s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1552040067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce70d5f6-d054-47ab-a2a2-0f11987dc190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c6969d75fa4c068a77fa2a148c2979',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:19Z,use_quota=True,user_id='11f93da40c7648dd9fc82d108b9c35c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Creating volume ce70d5f6-d054-47ab-a2a2-0f11987dc190 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:59:19 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ce70d5f6-d054-47ab-a2a2-0f11987dc190 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c5ba92-d2ed-4286-881e-22ca83df0417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17f8be6b-4379-4004-806d-1f48b42d8482', 'volume_size': 1, 'snapshot_id': 'e7b3a897-e168-4f1a-ab7a-cb41143fdf13'}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:19 devstack sudo[100051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ce70d5f6-d054-47ab-a2a2-0f11987dc190 1073741824
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc18b1bc-98cb-4c51-b492-d5f5cc4d6b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:19 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:19 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Volume volume-17f8be6b-4379-4004-806d-1f48b42d8482 (17f8be6b-4379-4004-806d-1f48b42d8482): created successfully
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc18b1bc-98cb-4c51-b492-d5f5cc4d6b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:19 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Flow 'volume_create_manager' (a1ec1eb0-97bb-4335-969f-c32c0cb8630e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:19 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e056d82d-17c3-4e97-86e2-bd1590e3cf74 tempest-VolumesSnapshotTestJSON-1945023076 None] Created volume successfully.
Sep 04 15:59:20 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ce70d5f6-d054-47ab-a2a2-0f11987dc190 1073741824" returned: 0 in 0.680s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ce70d5f6-d054-47ab-a2a2-0f11987dc190 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:20 devstack sudo[100057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ce70d5f6-d054-47ab-a2a2-0f11987dc190
Sep 04 15:59:20 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:20 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ce70d5f6-d054-47ab-a2a2-0f11987dc190" returned: 0 in 0.250s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:59:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:20 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee28bd1f-1d04-4d11-953a-472c32595d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce70d5f6-d054-47ab-a2a2-0f11987dc190', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:20 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39cf4e0-e599-439b-99b7-178f52957c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:20 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Volume volume-ce70d5f6-d054-47ab-a2a2-0f11987dc190 (ce70d5f6-d054-47ab-a2a2-0f11987dc190): created successfully
Sep 04 15:59:20 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39cf4e0-e599-439b-99b7-178f52957c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:20 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Flow 'volume_create_manager' (ec999443-68cd-4a24-97d5-bac38de080b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:20 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-3b7c4890-8524-496e-82f2-1ac90f1f909c tempest-VolumesMetadataTest-595643826 None] Created volume successfully.
Sep 04 15:59:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-12fece5f-a016-4ac8-973a-b2a318b78613 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "cinder-17f8be6b-4379-4004-806d-1f48b42d8482-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-12fece5f-a016-4ac8-973a-b2a318b78613 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-17f8be6b-4379-4004-806d-1f48b42d8482-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-12fece5f-a016-4ac8-973a-b2a318b78613 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "cinder-quobyte-17f8be6b-4379-4004-806d-1f48b42d8482" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-12fece5f-a016-4ac8-973a-b2a318b78613 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-17f8be6b-4379-4004-806d-1f48b42d8482" acquired by "delete_volume" :: waited 0.014s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:20 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf34011-8a77-4400-9e45-83beb5db899e]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-12fece5f-a016-4ac8-973a-b2a318b78613 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-17f8be6b-4379-4004-806d-1f48b42d8482 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:20 devstack sudo[100060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-17f8be6b-4379-4004-806d-1f48b42d8482
Sep 04 15:59:20 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:21 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-12fece5f-a016-4ac8-973a-b2a318b78613 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-17f8be6b-4379-4004-806d-1f48b42d8482" returned: 0 in 0.422s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-12fece5f-a016-4ac8-973a-b2a318b78613 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-17f8be6b-4379-4004-806d-1f48b42d8482 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:21 devstack sudo[100065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-17f8be6b-4379-4004-806d-1f48b42d8482
Sep 04 15:59:21 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:21 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-12fece5f-a016-4ac8-973a-b2a318b78613 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-17f8be6b-4379-4004-806d-1f48b42d8482" returned: 0 in 0.306s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-12fece5f-a016-4ac8-973a-b2a318b78613 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-17f8be6b-4379-4004-806d-1f48b42d8482" released by "delete_volume" :: held 0.781s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:21 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-12fece5f-a016-4ac8-973a-b2a318b78613 tempest-VolumesSnapshotTestJSON-1945023076 None] Created reservations ['fee1bc91-37e8-444d-b74e-ac7eb9dbebc8', '9881861d-9a08-4562-9fae-4f53ac38a255', 'd2f0ac2a-80ed-4c86-a430-8b052962787f', '6d4b1490-195d-4a9c-a72f-19bafa02a21a'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:59:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-12fece5f-a016-4ac8-973a-b2a318b78613 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-12fece5f-a016-4ac8-973a-b2a318b78613 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-12fece5f-a016-4ac8-973a-b2a318b78613 tempest-VolumesSnapshotTestJSON-1945023076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-12fece5f-a016-4ac8-973a-b2a318b78613 tempest-VolumesSnapshotTestJSON-1945023076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-12fece5f-a016-4ac8-973a-b2a318b78613 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-12fece5f-a016-4ac8-973a-b2a318b78613 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:21 devstack sudo[100070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:59:21 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0f44d449-3aea-4ccf-be02-9a7f9f69e3b4 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "cinder-e7b3a897-e168-4f1a-ab7a-cb41143fdf13-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0f44d449-3aea-4ccf-be02-9a7f9f69e3b4 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-e7b3a897-e168-4f1a-ab7a-cb41143fdf13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0f44d449-3aea-4ccf-be02-9a7f9f69e3b4 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "cinder-quobyte-008d2f8f-e712-4cbc-bf74-f15c040a88e7" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0f44d449-3aea-4ccf-be02-9a7f9f69e3b4 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-008d2f8f-e712-4cbc-bf74-f15c040a88e7" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0f44d449-3aea-4ccf-be02-9a7f9f69e3b4 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "cinder-quobyte-e7b3a897-e168-4f1a-ab7a-cb41143fdf13" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0f44d449-3aea-4ccf-be02-9a7f9f69e3b4 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-e7b3a897-e168-4f1a-ab7a-cb41143fdf13" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-0f44d449-3aea-4ccf-be02-9a7f9f69e3b4 tempest-VolumesSnapshotTestJSON-1945023076 None] Deleting offline snapshot e7b3a897-e168-4f1a-ab7a-cb41143fdf13 of volume 008d2f8f-e712-4cbc-bf74-f15c040a88e7 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 15:59:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-0f44d449-3aea-4ccf-be02-9a7f9f69e3b4 tempest-VolumesSnapshotTestJSON-1945023076 None] snapshot_file for this snap is: volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.e7b3a897-e168-4f1a-ab7a-cb41143fdf13 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 15:59:22 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be7a413-1738-42a0-b1d9-337430580ccd]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0f44d449-3aea-4ccf-be02-9a7f9f69e3b4 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.e7b3a897-e168-4f1a-ab7a-cb41143fdf13 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c7cc2963-7ede-48e1-8382-7f5f1fc9dc33 tempest-VolumesMetadataTest-595643826 None] Acquiring lock "cinder-ce70d5f6-d054-47ab-a2a2-0f11987dc190-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c7cc2963-7ede-48e1-8382-7f5f1fc9dc33 tempest-VolumesMetadataTest-595643826 None] Lock "cinder-ce70d5f6-d054-47ab-a2a2-0f11987dc190-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:22 devstack sudo[100072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.e7b3a897-e168-4f1a-ab7a-cb41143fdf13
Sep 04 15:59:22 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c7cc2963-7ede-48e1-8382-7f5f1fc9dc33 tempest-VolumesMetadataTest-595643826 None] Acquiring lock "cinder-quobyte-ce70d5f6-d054-47ab-a2a2-0f11987dc190" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c7cc2963-7ede-48e1-8382-7f5f1fc9dc33 tempest-VolumesMetadataTest-595643826 None] Lock "cinder-quobyte-ce70d5f6-d054-47ab-a2a2-0f11987dc190" acquired by "delete_volume" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:22 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[299ad3e7-4490-48a4-9354-23d2fdae0397]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c7cc2963-7ede-48e1-8382-7f5f1fc9dc33 tempest-VolumesMetadataTest-595643826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ce70d5f6-d054-47ab-a2a2-0f11987dc190 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:22 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-12fece5f-a016-4ac8-973a-b2a318b78613 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.684s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:22 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-12fece5f-a016-4ac8-973a-b2a318b78613 tempest-VolumesSnapshotTestJSON-1945023076 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:59:22 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-12fece5f-a016-4ac8-973a-b2a318b78613 tempest-VolumesSnapshotTestJSON-1945023076 None] Deleted volume successfully.
Sep 04 15:59:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-12fece5f-a016-4ac8-973a-b2a318b78613 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-17f8be6b-4379-4004-806d-1f48b42d8482-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:22 devstack sudo[100075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ce70d5f6-d054-47ab-a2a2-0f11987dc190
Sep 04 15:59:22 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:22 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0f44d449-3aea-4ccf-be02-9a7f9f69e3b4 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.e7b3a897-e168-4f1a-ab7a-cb41143fdf13" returned: 0 in 0.528s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-0f44d449-3aea-4ccf-be02-9a7f9f69e3b4 tempest-VolumesSnapshotTestJSON-1945023076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:59:22 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3998fe4b-8788-445d-a064-703a92e06934]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0f44d449-3aea-4ccf-be02-9a7f9f69e3b4 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:22 devstack sudo[100080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7
Sep 04 15:59:22 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:22 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c7cc2963-7ede-48e1-8382-7f5f1fc9dc33 tempest-VolumesMetadataTest-595643826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ce70d5f6-d054-47ab-a2a2-0f11987dc190" returned: 0 in 0.442s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c7cc2963-7ede-48e1-8382-7f5f1fc9dc33 tempest-VolumesMetadataTest-595643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ce70d5f6-d054-47ab-a2a2-0f11987dc190 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:22 devstack sudo[100085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ce70d5f6-d054-47ab-a2a2-0f11987dc190
Sep 04 15:59:22 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:23 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c7cc2963-7ede-48e1-8382-7f5f1fc9dc33 tempest-VolumesMetadataTest-595643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ce70d5f6-d054-47ab-a2a2-0f11987dc190" returned: 0 in 0.291s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c7cc2963-7ede-48e1-8382-7f5f1fc9dc33 tempest-VolumesMetadataTest-595643826 None] Lock "cinder-quobyte-ce70d5f6-d054-47ab-a2a2-0f11987dc190" released by "delete_volume" :: held 0.784s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:23 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-c7cc2963-7ede-48e1-8382-7f5f1fc9dc33 tempest-VolumesMetadataTest-595643826 None] Created reservations ['96fcdc34-331e-49a1-9a42-409e707a9b45', 'ffb91bca-4783-410d-a9bb-52c02c6a4d66', 'c55a9077-9bc5-4b66-803b-295dca56a928', '0570722c-55f7-415a-aeed-4491988d09f3'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:59:23 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0f44d449-3aea-4ccf-be02-9a7f9f69e3b4 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7" returned: 0 in 0.632s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0f44d449-3aea-4ccf-be02-9a7f9f69e3b4 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.e7b3a897-e168-4f1a-ab7a-cb41143fdf13 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:23 devstack sudo[100091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.e7b3a897-e168-4f1a-ab7a-cb41143fdf13
Sep 04 15:59:23 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c7cc2963-7ede-48e1-8382-7f5f1fc9dc33 tempest-VolumesMetadataTest-595643826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c7cc2963-7ede-48e1-8382-7f5f1fc9dc33 tempest-VolumesMetadataTest-595643826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c7cc2963-7ede-48e1-8382-7f5f1fc9dc33 tempest-VolumesMetadataTest-595643826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c7cc2963-7ede-48e1-8382-7f5f1fc9dc33 tempest-VolumesMetadataTest-595643826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c7cc2963-7ede-48e1-8382-7f5f1fc9dc33 tempest-VolumesMetadataTest-595643826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c7cc2963-7ede-48e1-8382-7f5f1fc9dc33 tempest-VolumesMetadataTest-595643826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:23 devstack sudo[100093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:59:23 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:23 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c7cc2963-7ede-48e1-8382-7f5f1fc9dc33 tempest-VolumesMetadataTest-595643826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.318s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:23 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-c7cc2963-7ede-48e1-8382-7f5f1fc9dc33 tempest-VolumesMetadataTest-595643826 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:59:23 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-c7cc2963-7ede-48e1-8382-7f5f1fc9dc33 tempest-VolumesMetadataTest-595643826 None] Deleted volume successfully.
Sep 04 15:59:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c7cc2963-7ede-48e1-8382-7f5f1fc9dc33 tempest-VolumesMetadataTest-595643826 None] Lock "cinder-ce70d5f6-d054-47ab-a2a2-0f11987dc190-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:23 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0f44d449-3aea-4ccf-be02-9a7f9f69e3b4 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.e7b3a897-e168-4f1a-ab7a-cb41143fdf13" returned: 0 in 0.614s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0f44d449-3aea-4ccf-be02-9a7f9f69e3b4 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.e7b3a897-e168-4f1a-ab7a-cb41143fdf13 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:24 devstack sudo[100100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.e7b3a897-e168-4f1a-ab7a-cb41143fdf13
Sep 04 15:59:24 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Flow 'volume_create_manager' (38e027bd-2f0f-4c64-9949-37445198cd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c08f32-9c5c-472e-b660-73bb5681aad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c08f32-9c5c-472e-b660-73bb5681aad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-668382061',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94883679-1acc-4565-a0a6-e740a9cfebc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9d3dddc9144baabb500df7aa327bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:24Z,use_quota=True,user_id='abdec43992d0452b91c6e292e682117a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4daadf1-c0f3-47ec-938d-c5828c19705e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4daadf1-c0f3-47ec-938d-c5828c19705e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a51b410d-f673-4f91-8c48-9c0549182c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a51b410d-f673-4f91-8c48-9c0549182c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94883679-1acc-4565-a0a6-e740a9cfebc6', 'volume_name': 'volume-94883679-1acc-4565-a0a6-e740a9cfebc6', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85fbd0a-6881-406c-ac2c-5881f5d953b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85fbd0a-6881-406c-ac2c-5881f5d953b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4059efa-a322-4d50-be21-a6c4e4224fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:24 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Volume 94883679-1acc-4565-a0a6-e740a9cfebc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94883679-1acc-4565-a0a6-e740a9cfebc6', 'volume_size': 1}
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-668382061',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94883679-1acc-4565-a0a6-e740a9cfebc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a9d3dddc9144baabb500df7aa327bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:24Z,use_quota=True,user_id='abdec43992d0452b91c6e292e682117a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Creating volume 94883679-1acc-4565-a0a6-e740a9cfebc6 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:59:24 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-94883679-1acc-4565-a0a6-e740a9cfebc6 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:24 devstack sudo[100104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-94883679-1acc-4565-a0a6-e740a9cfebc6 1073741824
Sep 04 15:59:24 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:24 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0f44d449-3aea-4ccf-be02-9a7f9f69e3b4 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7.e7b3a897-e168-4f1a-ab7a-cb41143fdf13" returned: 0 in 0.322s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0f44d449-3aea-4ccf-be02-9a7f9f69e3b4 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-e7b3a897-e168-4f1a-ab7a-cb41143fdf13" released by "_delete_snapshot" :: held 2.237s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0f44d449-3aea-4ccf-be02-9a7f9f69e3b4 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-008d2f8f-e712-4cbc-bf74-f15c040a88e7" released by "delete_snapshot" :: held 2.272s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-0f44d449-3aea-4ccf-be02-9a7f9f69e3b4 tempest-VolumesSnapshotTestJSON-1945023076 None] Created reservations ['7cc4a250-c9c0-4fcf-83fe-ea2604ece004', '9945f095-1451-415b-add3-7f006ad9c841', '93ef00b5-5804-472c-b16c-31647730b078', '78f8060b-7435-4b5d-873c-99cbabe59946'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:59:24 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-0f44d449-3aea-4ccf-be02-9a7f9f69e3b4 tempest-VolumesSnapshotTestJSON-1945023076 None] Delete snapshot completed successfully.
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0f44d449-3aea-4ccf-be02-9a7f9f69e3b4 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-e7b3a897-e168-4f1a-ab7a-cb41143fdf13-delete_snapshot" released by "delete_snapshot" :: held 2.546s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:24 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-94883679-1acc-4565-a0a6-e740a9cfebc6 1073741824" returned: 0 in 0.572s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-94883679-1acc-4565-a0a6-e740a9cfebc6 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:24 devstack sudo[100112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-94883679-1acc-4565-a0a6-e740a9cfebc6
Sep 04 15:59:24 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:25 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-94883679-1acc-4565-a0a6-e740a9cfebc6" returned: 0 in 0.331s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:25 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:59:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4059efa-a322-4d50-be21-a6c4e4224fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94883679-1acc-4565-a0a6-e740a9cfebc6', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77540c44-d065-49ce-b4b2-56c660ff00b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:25 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Volume volume-94883679-1acc-4565-a0a6-e740a9cfebc6 (94883679-1acc-4565-a0a6-e740a9cfebc6): created successfully
Sep 04 15:59:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77540c44-d065-49ce-b4b2-56c660ff00b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Flow 'volume_create_manager' (38e027bd-2f0f-4c64-9949-37445198cd13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:25 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-3c502480-59e4-4d4f-86c2-52ac15b8f23b tempest-AbsoluteLimitsTests-993698607 None] Created volume successfully.
Sep 04 15:59:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c0d4bf52-494b-4dcc-9690-cc36545ff532 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "cinder-008d2f8f-e712-4cbc-bf74-f15c040a88e7-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c0d4bf52-494b-4dcc-9690-cc36545ff532 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-008d2f8f-e712-4cbc-bf74-f15c040a88e7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c0d4bf52-494b-4dcc-9690-cc36545ff532 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "cinder-quobyte-008d2f8f-e712-4cbc-bf74-f15c040a88e7" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c0d4bf52-494b-4dcc-9690-cc36545ff532 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-008d2f8f-e712-4cbc-bf74-f15c040a88e7" acquired by "delete_volume" :: waited 0.021s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:25 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e707aef-1116-4f62-b0af-90e5adc25b29]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c0d4bf52-494b-4dcc-9690-cc36545ff532 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:25 devstack sudo[100115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7
Sep 04 15:59:25 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:25 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c0d4bf52-494b-4dcc-9690-cc36545ff532 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7" returned: 0 in 0.472s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c0d4bf52-494b-4dcc-9690-cc36545ff532 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:26 devstack sudo[100120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7
Sep 04 15:59:26 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:26 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c0d4bf52-494b-4dcc-9690-cc36545ff532 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-008d2f8f-e712-4cbc-bf74-f15c040a88e7" returned: 0 in 0.319s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:26 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c0d4bf52-494b-4dcc-9690-cc36545ff532 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-008d2f8f-e712-4cbc-bf74-f15c040a88e7" released by "delete_volume" :: held 0.901s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:26 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-492fde59-901d-4307-8fa8-d59eb9b95ab5 tempest-AbsoluteLimitsTests-993698607 None] Acquiring lock "cinder-94883679-1acc-4565-a0a6-e740a9cfebc6-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:26 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-492fde59-901d-4307-8fa8-d59eb9b95ab5 tempest-AbsoluteLimitsTests-993698607 None] Lock "cinder-94883679-1acc-4565-a0a6-e740a9cfebc6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:26 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-c0d4bf52-494b-4dcc-9690-cc36545ff532 tempest-VolumesSnapshotTestJSON-1945023076 None] Created reservations ['7b18a63a-cf3b-4502-a86d-f3a74858214f', '8d58e2a7-62a1-4913-b741-b13ecafbbdc5', '378c96b4-c8f1-4ec9-be45-c453413595f2', '87c1924a-1665-473b-a324-5cf2f43333a3'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:59:26 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-492fde59-901d-4307-8fa8-d59eb9b95ab5 tempest-AbsoluteLimitsTests-993698607 None] Acquiring lock "cinder-quobyte-94883679-1acc-4565-a0a6-e740a9cfebc6" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:26 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-492fde59-901d-4307-8fa8-d59eb9b95ab5 tempest-AbsoluteLimitsTests-993698607 None] Lock "cinder-quobyte-94883679-1acc-4565-a0a6-e740a9cfebc6" acquired by "delete_volume" :: waited 0.028s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:26 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0663374f-296f-463c-b5a5-c274bc7c23bb]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-492fde59-901d-4307-8fa8-d59eb9b95ab5 tempest-AbsoluteLimitsTests-993698607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-94883679-1acc-4565-a0a6-e740a9cfebc6 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c0d4bf52-494b-4dcc-9690-cc36545ff532 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c0d4bf52-494b-4dcc-9690-cc36545ff532 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c0d4bf52-494b-4dcc-9690-cc36545ff532 tempest-VolumesSnapshotTestJSON-1945023076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c0d4bf52-494b-4dcc-9690-cc36545ff532 tempest-VolumesSnapshotTestJSON-1945023076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c0d4bf52-494b-4dcc-9690-cc36545ff532 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c0d4bf52-494b-4dcc-9690-cc36545ff532 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:26 devstack sudo[100124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:59:26 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:26 devstack sudo[100123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-94883679-1acc-4565-a0a6-e740a9cfebc6
Sep 04 15:59:26 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:27 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:27 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-492fde59-901d-4307-8fa8-d59eb9b95ab5 tempest-AbsoluteLimitsTests-993698607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-94883679-1acc-4565-a0a6-e740a9cfebc6" returned: 0 in 0.435s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-492fde59-901d-4307-8fa8-d59eb9b95ab5 tempest-AbsoluteLimitsTests-993698607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-94883679-1acc-4565-a0a6-e740a9cfebc6 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c0d4bf52-494b-4dcc-9690-cc36545ff532 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.358s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-c0d4bf52-494b-4dcc-9690-cc36545ff532 tempest-VolumesSnapshotTestJSON-1945023076 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:59:27 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-c0d4bf52-494b-4dcc-9690-cc36545ff532 tempest-VolumesSnapshotTestJSON-1945023076 None] Deleted volume successfully.
Sep 04 15:59:27 devstack sudo[100131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-94883679-1acc-4565-a0a6-e740a9cfebc6
Sep 04 15:59:27 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c0d4bf52-494b-4dcc-9690-cc36545ff532 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-008d2f8f-e712-4cbc-bf74-f15c040a88e7-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:27 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-492fde59-901d-4307-8fa8-d59eb9b95ab5 tempest-AbsoluteLimitsTests-993698607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-94883679-1acc-4565-a0a6-e740a9cfebc6" returned: 0 in 0.297s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-492fde59-901d-4307-8fa8-d59eb9b95ab5 tempest-AbsoluteLimitsTests-993698607 None] Lock "cinder-quobyte-94883679-1acc-4565-a0a6-e740a9cfebc6" released by "delete_volume" :: held 0.805s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-492fde59-901d-4307-8fa8-d59eb9b95ab5 tempest-AbsoluteLimitsTests-993698607 None] Created reservations ['f2d518ed-ba05-4dcb-9af2-1ce49e15f0ba', '2d76af75-9b9e-4fed-9a19-c9b7ae856d8d', '9e1366b2-18f1-4429-b619-b72f4d122ae3', '7d46d327-4c74-4fa4-bcef-7f5719523a4d'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-492fde59-901d-4307-8fa8-d59eb9b95ab5 tempest-AbsoluteLimitsTests-993698607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-492fde59-901d-4307-8fa8-d59eb9b95ab5 tempest-AbsoluteLimitsTests-993698607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-492fde59-901d-4307-8fa8-d59eb9b95ab5 tempest-AbsoluteLimitsTests-993698607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-492fde59-901d-4307-8fa8-d59eb9b95ab5 tempest-AbsoluteLimitsTests-993698607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-492fde59-901d-4307-8fa8-d59eb9b95ab5 tempest-AbsoluteLimitsTests-993698607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-492fde59-901d-4307-8fa8-d59eb9b95ab5 tempest-AbsoluteLimitsTests-993698607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:27 devstack sudo[100134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:59:27 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Flow 'volume_create_manager' (8cbcb2ec-d0b7-4e96-bb8e-9911852d8c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b795d183-8a18-4c21-8ad5-2284736a4ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b795d183-8a18-4c21-8ad5-2284736a4ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-348528507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4088239-c4a3-4250-8633-bf8c80fab4f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='232e92a9ee7f41629d84e4228b519c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:28Z,use_quota=True,user_id='1becf1df414648af98c06f2f97415016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae375d2-a59c-473b-9b63-859b3969b6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae375d2-a59c-473b-9b63-859b3969b6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d90c0e-789c-47e8-814c-6c570b92ca56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d90c0e-789c-47e8-814c-6c570b92ca56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4088239-c4a3-4250-8633-bf8c80fab4f1', 'volume_name': 'volume-c4088239-c4a3-4250-8633-bf8c80fab4f1', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab42f7e8-02a6-4cc3-8475-08793f965145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab42f7e8-02a6-4cc3-8475-08793f965145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9213b3bb-2341-41f4-9516-561f85d9ceeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:27 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Volume c4088239-c4a3-4250-8633-bf8c80fab4f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4088239-c4a3-4250-8633-bf8c80fab4f1', 'volume_size': 1}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-348528507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4088239-c4a3-4250-8633-bf8c80fab4f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='232e92a9ee7f41629d84e4228b519c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:28Z,use_quota=True,user_id='1becf1df414648af98c06f2f97415016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Creating volume c4088239-c4a3-4250-8633-bf8c80fab4f1 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:59:27 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:27 devstack sudo[100136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1 1073741824
Sep 04 15:59:27 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2e4d9486-cf6a-4870-8392-7d8fdca313d1 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "cinder-efb44382-9d7c-4876-8d07-2fb07ed490ae-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2e4d9486-cf6a-4870-8392-7d8fdca313d1 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-efb44382-9d7c-4876-8d07-2fb07ed490ae-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2e4d9486-cf6a-4870-8392-7d8fdca313d1 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "cinder-quobyte-efb44382-9d7c-4876-8d07-2fb07ed490ae" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:27 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2e4d9486-cf6a-4870-8392-7d8fdca313d1 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-efb44382-9d7c-4876-8d07-2fb07ed490ae" acquired by "delete_volume" :: waited 0.034s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:28 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-492fde59-901d-4307-8fa8-d59eb9b95ab5 tempest-AbsoluteLimitsTests-993698607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.490s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:28 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-492fde59-901d-4307-8fa8-d59eb9b95ab5 tempest-AbsoluteLimitsTests-993698607 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:59:28 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-492fde59-901d-4307-8fa8-d59eb9b95ab5 tempest-AbsoluteLimitsTests-993698607 None] Deleted volume successfully.
Sep 04 15:59:28 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e000e1-2ad3-4fc4-ab7f-5b614466d49f]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2e4d9486-cf6a-4870-8392-7d8fdca313d1 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:28 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-492fde59-901d-4307-8fa8-d59eb9b95ab5 tempest-AbsoluteLimitsTests-993698607 None] Lock "cinder-94883679-1acc-4565-a0a6-e740a9cfebc6-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:28 devstack sudo[100141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae
Sep 04 15:59:28 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:28 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1 1073741824" returned: 0 in 0.584s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:28 devstack sudo[100145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1
Sep 04 15:59:28 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:28 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2e4d9486-cf6a-4870-8392-7d8fdca313d1 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae" returned: 0 in 0.519s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2e4d9486-cf6a-4870-8392-7d8fdca313d1 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:28 devstack sudo[100150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae
Sep 04 15:59:28 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:28 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1" returned: 0 in 0.427s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:59:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9213b3bb-2341-41f4-9516-561f85d9ceeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4088239-c4a3-4250-8633-bf8c80fab4f1', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd020b83-cdc5-4cce-b40d-762dc9932990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:28 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Volume volume-c4088239-c4a3-4250-8633-bf8c80fab4f1 (c4088239-c4a3-4250-8633-bf8c80fab4f1): created successfully
Sep 04 15:59:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd020b83-cdc5-4cce-b40d-762dc9932990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Flow 'volume_create_manager' (8cbcb2ec-d0b7-4e96-bb8e-9911852d8c16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:28 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e9056ccb-a005-430b-857d-330778814e59 tempest-VolumesCloneTest-1562120839 None] Created volume successfully.
Sep 04 15:59:28 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2e4d9486-cf6a-4870-8392-7d8fdca313d1 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-efb44382-9d7c-4876-8d07-2fb07ed490ae" returned: 0 in 0.348s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:28 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2e4d9486-cf6a-4870-8392-7d8fdca313d1 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-quobyte-efb44382-9d7c-4876-8d07-2fb07ed490ae" released by "delete_volume" :: held 0.974s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:29 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-2e4d9486-cf6a-4870-8392-7d8fdca313d1 tempest-VolumesSnapshotTestJSON-1945023076 None] Created reservations ['3d8670ef-4e53-4d43-b218-c13368817688', 'cebb6b3d-da4b-4d20-8519-2c0c805f6548', '189045e5-054e-4849-af79-e69e8e7db85c', 'f5383d8a-509f-4ab4-bf87-70d7e53ebc2a'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:59:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2e4d9486-cf6a-4870-8392-7d8fdca313d1 tempest-VolumesSnapshotTestJSON-1945023076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2e4d9486-cf6a-4870-8392-7d8fdca313d1 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:29 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2e4d9486-cf6a-4870-8392-7d8fdca313d1 tempest-VolumesSnapshotTestJSON-1945023076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:29 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2e4d9486-cf6a-4870-8392-7d8fdca313d1 tempest-VolumesSnapshotTestJSON-1945023076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2e4d9486-cf6a-4870-8392-7d8fdca313d1 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2e4d9486-cf6a-4870-8392-7d8fdca313d1 tempest-VolumesSnapshotTestJSON-1945023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:29 devstack sudo[100154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:59:29 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:29 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2e4d9486-cf6a-4870-8392-7d8fdca313d1 tempest-VolumesSnapshotTestJSON-1945023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.334s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:29 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-2e4d9486-cf6a-4870-8392-7d8fdca313d1 tempest-VolumesSnapshotTestJSON-1945023076 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:59:29 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-2e4d9486-cf6a-4870-8392-7d8fdca313d1 tempest-VolumesSnapshotTestJSON-1945023076 None] Deleted volume successfully.
Sep 04 15:59:29 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2e4d9486-cf6a-4870-8392-7d8fdca313d1 tempest-VolumesSnapshotTestJSON-1945023076 None] Lock "cinder-efb44382-9d7c-4876-8d07-2fb07ed490ae-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:30 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:59:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Flow 'volume_create_manager' (31ecc0cd-29ce-4e63-9ac2-e7f962174df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e34275e4-64c5-4ab9-8ca4-5f92e7a1796a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e34275e4-64c5-4ab9-8ca4-5f92e7a1796a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2027831766',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3371aae6-eae0-4627-a6ce-787b1c232a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='232e92a9ee7f41629d84e4228b519c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=c4088239-c4a3-4250-8633-bf8c80fab4f1,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:31Z,use_quota=True,user_id='1becf1df414648af98c06f2f97415016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67fe4df5-4a57-4af0-a11d-9a5aa24f8761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67fe4df5-4a57-4af0-a11d-9a5aa24f8761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed025f0-42f4-4e81-97b8-0bd3bee43499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed025f0-42f4-4e81-97b8-0bd3bee43499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3371aae6-eae0-4627-a6ce-787b1c232a21', 'volume_name': 'volume-3371aae6-eae0-4627-a6ce-787b1c232a21', 'volume_size': 2, 'source_volid': 'c4088239-c4a3-4250-8633-bf8c80fab4f1', 'source_volstatus': 'available'}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d236b7fd-2948-48e2-a1c5-800a3ceebede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d236b7fd-2948-48e2-a1c5-800a3ceebede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b3bcba-59fe-4d13-a098-71c176136ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:30 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Volume 3371aae6-eae0-4627-a6ce-787b1c232a21: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3371aae6-eae0-4627-a6ce-787b1c232a21', 'volume_size': 2, 'source_volid': 'c4088239-c4a3-4250-8633-bf8c80fab4f1', 'source_volstatus': 'available'}
Sep 04 15:59:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:30 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Cloning volume c4088239-c4a3-4250-8633-bf8c80fab4f1 to volume 3371aae6-eae0-4627-a6ce-787b1c232a21
Sep 04 15:59:30 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Creating offline snapshot 40e54932-fc47-429f-8250-0c8bc3cd9d79 of volume c4088239-c4a3-4250-8633-bf8c80fab4f1 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:59:31 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff563e0-0810-40eb-9610-2c6c86889108]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:31 devstack sudo[100157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1
Sep 04 15:59:31 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:31 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1" returned: 0 in 0.476s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.40e54932-fc47-429f-8250-0c8bc3cd9d79 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:31 devstack sudo[100162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.40e54932-fc47-429f-8250-0c8bc3cd9d79 1G
Sep 04 15:59:31 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:32 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.40e54932-fc47-429f-8250-0c8bc3cd9d79 1G" returned: 0 in 0.608s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4088239-c4a3-4250-8633-bf8c80fab4f1 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.40e54932-fc47-429f-8250-0c8bc3cd9d79 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:32 devstack sudo[100169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4088239-c4a3-4250-8633-bf8c80fab4f1 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.40e54932-fc47-429f-8250-0c8bc3cd9d79
Sep 04 15:59:32 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:32 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4088239-c4a3-4250-8633-bf8c80fab4f1 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.40e54932-fc47-429f-8250-0c8bc3cd9d79" returned: 0 in 0.317s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:32 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.40e54932-fc47-429f-8250-0c8bc3cd9d79 is being set with open permissions: ugo+rw
Sep 04 15:59:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.40e54932-fc47-429f-8250-0c8bc3cd9d79 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:32 devstack sudo[100176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.40e54932-fc47-429f-8250-0c8bc3cd9d79
Sep 04 15:59:32 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:32 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.40e54932-fc47-429f-8250-0c8bc3cd9d79" returned: 0 in 0.356s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:32 devstack sudo[100179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.info
Sep 04 15:59:32 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:33 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.info" returned: 0 in 0.309s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:33 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.info is being set with open permissions: ugo+rw
Sep 04 15:59:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:33 devstack sudo[100183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.info
Sep 04 15:59:33 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:33 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.info" returned: 0 in 0.315s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:33 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Acquiring lock "cinder-quobyte-3371aae6-eae0-4627-a6ce-787b1c232a21" by "_copy_volume_from_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:33 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Lock "cinder-quobyte-3371aae6-eae0-4627-a6ce-787b1c232a21" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:33 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] snapshot: 40e54932-fc47-429f-8250-0c8bc3cd9d79, volume: 3371aae6-eae0-4627-a6ce-787b1c232a21,  {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 04 15:59:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:33 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:33 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:33 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7739406e-40a8-4c11-a2cc-57a37957d425]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.40e54932-fc47-429f-8250-0c8bc3cd9d79 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:33 devstack sudo[100186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.40e54932-fc47-429f-8250-0c8bc3cd9d79
Sep 04 15:59:33 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:33 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:59:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Flow 'volume_create_manager' (a9dc2e3e-ad83-47fb-97c0-14bf5b49ce00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (345e5505-b9c2-477a-8406-df9bf9e1343f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:33 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.40e54932-fc47-429f-8250-0c8bc3cd9d79" returned: 0 in 0.481s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4088239-c4a3-4250-8633-bf8c80fab4f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (345e5505-b9c2-477a-8406-df9bf9e1343f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-614034200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a84575c8-4c1e-43d2-a2b3-24faf5ba215b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeba0df0bcae42f1aef552a70bfa3f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:34Z,use_quota=True,user_id='6baf269a6e88436abae71b49792cb470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d946a0-0e49-40e0-9001-20d85fbddc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d946a0-0e49-40e0-9001-20d85fbddc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (675a8b7a-6a26-4286-86dc-3eeddb358feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (675a8b7a-6a26-4286-86dc-3eeddb358feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a84575c8-4c1e-43d2-a2b3-24faf5ba215b', 'volume_name': 'volume-a84575c8-4c1e-43d2-a2b3-24faf5ba215b', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a619dc-8b14-40e0-b06a-8e59d7126e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a619dc-8b14-40e0-b06a-8e59d7126e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c268f99-eb62-4a5a-9337-a317ca20b65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:34 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Volume a84575c8-4c1e-43d2-a2b3-24faf5ba215b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a84575c8-4c1e-43d2-a2b3-24faf5ba215b', 'volume_size': 1}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb23b92-3c1e-499f-92c4-3f47db25c984]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:34 devstack sudo[100191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1
Sep 04 15:59:34 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Flow 'volume_create_manager' (ae2411df-7dc4-498d-bc62-900a23450995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6032de2-ba6f-4e68-aa97-7c20e5338696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6032de2-ba6f-4e68-aa97-7c20e5338696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2129510034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35f75f1-2411-45c7-a1e2-419bf0ac9f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf2b7adb0b9477b8502311f571962fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:34Z,use_quota=True,user_id='b3f0d76282f1485dae98879b6a6624d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35327ce0-7973-4933-b85d-95d5c6b66d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35327ce0-7973-4933-b85d-95d5c6b66d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40fb93b4-2c34-4dad-81ca-029e6ed0d7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40fb93b4-2c34-4dad-81ca-029e6ed0d7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a35f75f1-2411-45c7-a1e2-419bf0ac9f5a', 'volume_name': 'volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc8db2ba-6037-438f-b5d7-5705b463864d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc8db2ba-6037-438f-b5d7-5705b463864d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e16f7fe1-3839-43f1-9a64-5b4b5f3aa907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:34 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Volume a35f75f1-2411-45c7-a1e2-419bf0ac9f5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a', 'volume_size': 1}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:34 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1" returned: 0 in 0.424s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1 {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Creating direct copy from snapshot {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG cinder.utils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Path /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3371aae6-eae0-4627-a6ce-787b1c232a21 not found in is_blk_device check {{(pid=87504) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 04 15:59:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3371aae6-eae0-4627-a6ce-787b1c232a21 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:34 devstack sudo[100198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3371aae6-eae0-4627-a6ce-787b1c232a21
Sep 04 15:59:34 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:39 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3371aae6-eae0-4627-a6ce-787b1c232a21" returned: 0 in 5.353s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:39 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1, size 1024.00 MB, duration 5.35 sec, destination /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3371aae6-eae0-4627-a6ce-787b1c232a21 {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 15:59:39 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Converted 1024.00 MB image at 191.27 MB/s
Sep 04 15:59:39 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3371aae6-eae0-4627-a6ce-787b1c232a21 is being set with open permissions: ugo+rw
Sep 04 15:59:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3371aae6-eae0-4627-a6ce-787b1c232a21 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:39 devstack sudo[100213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3371aae6-eae0-4627-a6ce-787b1c232a21
Sep 04 15:59:39 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:40 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3371aae6-eae0-4627-a6ce-787b1c232a21" returned: 0 in 0.274s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:40 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Lock "cinder-quobyte-3371aae6-eae0-4627-a6ce-787b1c232a21" released by "_copy_volume_from_snapshot" :: held 6.677s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:40 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Acquiring lock "cinder-quobyte-40e54932-fc47-429f-8250-0c8bc3cd9d79" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:40 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Lock "cinder-quobyte-40e54932-fc47-429f-8250-0c8bc3cd9d79" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:40 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Deleting offline snapshot 40e54932-fc47-429f-8250-0c8bc3cd9d79 of volume c4088239-c4a3-4250-8633-bf8c80fab4f1 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 15:59:40 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] snapshot_file for this snap is: volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.40e54932-fc47-429f-8250-0c8bc3cd9d79 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 15:59:40 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07bc944-eedc-4618-a722-af93d197dff8]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.40e54932-fc47-429f-8250-0c8bc3cd9d79 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:40 devstack sudo[100216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.40e54932-fc47-429f-8250-0c8bc3cd9d79
Sep 04 15:59:40 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:40 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.40e54932-fc47-429f-8250-0c8bc3cd9d79" returned: 0 in 0.442s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:40 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4088239-c4a3-4250-8633-bf8c80fab4f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:59:40 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56a461b-b269-4ad8-bd10-0afb12288393]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:40 devstack sudo[100221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1
Sep 04 15:59:40 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:41 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1" returned: 0 in 0.566s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.40e54932-fc47-429f-8250-0c8bc3cd9d79 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:41 devstack sudo[100226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.40e54932-fc47-429f-8250-0c8bc3cd9d79
Sep 04 15:59:41 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:41 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.40e54932-fc47-429f-8250-0c8bc3cd9d79" returned: 0 in 0.420s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.40e54932-fc47-429f-8250-0c8bc3cd9d79 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:41 devstack sudo[100231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.40e54932-fc47-429f-8250-0c8bc3cd9d79
Sep 04 15:59:41 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:59:42 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Flow 'volume_create_manager' (b105edda-1cb9-4092-8782-19ee25780eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6609b41a-1b21-4525-bd38-199d07ae6a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1.40e54932-fc47-429f-8250-0c8bc3cd9d79" returned: 0 in 0.336s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6609b41a-1b21-4525-bd38-199d07ae6a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1546841802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d95ac72-a1a8-446e-b406-15157718a04f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65006be930624383b15680779ae3709d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:42Z,use_quota=True,user_id='5509514dbb9047ffa24f3bd66dd01133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e2f76a-daee-400c-ba2a-eab37381eff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e2f76a-daee-400c-ba2a-eab37381eff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b3559e-c19b-46ce-b233-dc78f142056b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b3559e-c19b-46ce-b233-dc78f142056b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d95ac72-a1a8-446e-b406-15157718a04f', 'volume_name': 'volume-2d95ac72-a1a8-446e-b406-15157718a04f', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7589d0d8-b092-488c-92e0-65caa9ef5a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7589d0d8-b092-488c-92e0-65caa9ef5a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990db1b6-1372-425d-809f-bd9a5ebf8455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:42 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Volume 2d95ac72-a1a8-446e-b406-15157718a04f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d95ac72-a1a8-446e-b406-15157718a04f', 'volume_size': 1}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Lock "cinder-quobyte-40e54932-fc47-429f-8250-0c8bc3cd9d79" released by "_delete_snapshot" :: held 1.933s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.237s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.095s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-614034200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a84575c8-4c1e-43d2-a2b3-24faf5ba215b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeba0df0bcae42f1aef552a70bfa3f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:34Z,use_quota=True,user_id='6baf269a6e88436abae71b49792cb470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Creating volume a84575c8-4c1e-43d2-a2b3-24faf5ba215b {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:59:42 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a84575c8-4c1e-43d2-a2b3-24faf5ba215b 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:42 devstack sudo[100234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a84575c8-4c1e-43d2-a2b3-24faf5ba215b 1073741824
Sep 04 15:59:42 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b3bcba-59fe-4d13-a098-71c176136ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3371aae6-eae0-4627-a6ce-787b1c232a21', 'volume_size': 2, 'source_volid': 'c4088239-c4a3-4250-8633-bf8c80fab4f1', 'source_volstatus': 'available'}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96cb83fb-af4f-4430-9d8a-e95be68e0f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:42 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Volume volume-3371aae6-eae0-4627-a6ce-787b1c232a21 (3371aae6-eae0-4627-a6ce-787b1c232a21): created successfully
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96cb83fb-af4f-4430-9d8a-e95be68e0f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Flow 'volume_create_manager' (31ecc0cd-29ce-4e63-9ac2-e7f962174df9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:42 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-22b19717-6c68-43af-bc2d-37b389de0b0a tempest-VolumesCloneTest-1562120839 None] Created volume successfully.
Sep 04 15:59:42 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a84575c8-4c1e-43d2-a2b3-24faf5ba215b 1073741824" returned: 0 in 0.430s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a84575c8-4c1e-43d2-a2b3-24faf5ba215b {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:42 devstack sudo[100240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a84575c8-4c1e-43d2-a2b3-24faf5ba215b
Sep 04 15:59:42 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:42 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a84575c8-4c1e-43d2-a2b3-24faf5ba215b" returned: 0 in 0.285s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.533s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2129510034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35f75f1-2411-45c7-a1e2-419bf0ac9f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf2b7adb0b9477b8502311f571962fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:34Z,use_quota=True,user_id='b3f0d76282f1485dae98879b6a6624d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Creating volume a35f75f1-2411-45c7-a1e2-419bf0ac9f5a {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:59:42 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c268f99-eb62-4a5a-9337-a317ca20b65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a84575c8-4c1e-43d2-a2b3-24faf5ba215b', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:42 devstack sudo[100243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a 1073741824
Sep 04 15:59:42 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d43c11a-61ae-4711-ba80-7efee204951f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:43 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Volume volume-a84575c8-4c1e-43d2-a2b3-24faf5ba215b (a84575c8-4c1e-43d2-a2b3-24faf5ba215b): created successfully
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d43c11a-61ae-4711-ba80-7efee204951f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Flow 'volume_create_manager' (a9dc2e3e-ad83-47fb-97c0-14bf5b49ce00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:43 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-9234be74-c36f-4589-9d71-69d1674a5de2 tempest-ProjectReaderTests-1198497729 None] Created volume successfully.
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-71747de5-1bbb-4cbf-83b6-08a5f8175861 tempest-VolumesCloneTest-1562120839 None] Acquiring lock "cinder-3371aae6-eae0-4627-a6ce-787b1c232a21-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-71747de5-1bbb-4cbf-83b6-08a5f8175861 tempest-VolumesCloneTest-1562120839 None] Lock "cinder-3371aae6-eae0-4627-a6ce-787b1c232a21-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-71747de5-1bbb-4cbf-83b6-08a5f8175861 tempest-VolumesCloneTest-1562120839 None] Acquiring lock "cinder-quobyte-3371aae6-eae0-4627-a6ce-787b1c232a21" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-71747de5-1bbb-4cbf-83b6-08a5f8175861 tempest-VolumesCloneTest-1562120839 None] Lock "cinder-quobyte-3371aae6-eae0-4627-a6ce-787b1c232a21" acquired by "delete_volume" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b500b16-6192-4ac8-ab32-1f68a9cb3b7e]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-71747de5-1bbb-4cbf-83b6-08a5f8175861 tempest-VolumesCloneTest-1562120839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3371aae6-eae0-4627-a6ce-787b1c232a21 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:43 devstack sudo[100247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3371aae6-eae0-4627-a6ce-787b1c232a21
Sep 04 15:59:43 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:43 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a 1073741824" returned: 0 in 0.548s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:43 devstack sudo[100251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a
Sep 04 15:59:43 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:43 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-71747de5-1bbb-4cbf-83b6-08a5f8175861 tempest-VolumesCloneTest-1562120839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3371aae6-eae0-4627-a6ce-787b1c232a21" returned: 0 in 0.392s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-71747de5-1bbb-4cbf-83b6-08a5f8175861 tempest-VolumesCloneTest-1562120839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3371aae6-eae0-4627-a6ce-787b1c232a21 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:43 devstack sudo[100256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3371aae6-eae0-4627-a6ce-787b1c232a21
Sep 04 15:59:43 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:43 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a" returned: 0 in 0.295s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.724s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1546841802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d95ac72-a1a8-446e-b406-15157718a04f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65006be930624383b15680779ae3709d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:42Z,use_quota=True,user_id='5509514dbb9047ffa24f3bd66dd01133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Creating volume 2d95ac72-a1a8-446e-b406-15157718a04f {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:59:43 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:43 devstack sudo[100259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f 1073741824
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e16f7fe1-3839-43f1-9a64-5b4b5f3aa907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:43 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e1e6e5-4f2a-4d82-93f8-2f68fab377b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:43 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Volume volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a (a35f75f1-2411-45c7-a1e2-419bf0ac9f5a): created successfully
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e1e6e5-4f2a-4d82-93f8-2f68fab377b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Flow 'volume_create_manager' (ae2411df-7dc4-498d-bc62-900a23450995) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:43 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-71747de5-1bbb-4cbf-83b6-08a5f8175861 tempest-VolumesCloneTest-1562120839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3371aae6-eae0-4627-a6ce-787b1c232a21" returned: 0 in 0.296s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:43 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-4d255934-a3e8-4749-a7e9-d18825316bb4 tempest-VolumesDeleteCascade-925960500 None] Created volume successfully.
Sep 04 15:59:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-71747de5-1bbb-4cbf-83b6-08a5f8175861 tempest-VolumesCloneTest-1562120839 None] Lock "cinder-quobyte-3371aae6-eae0-4627-a6ce-787b1c232a21" released by "delete_volume" :: held 0.749s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-71747de5-1bbb-4cbf-83b6-08a5f8175861 tempest-VolumesCloneTest-1562120839 None] Created reservations ['2c53326d-0c68-414c-897c-5ea5b293948d', '35bf40a4-b6b7-418e-9fef-caed35bff8f4', 'e627540c-9dfd-4588-b0c3-d7c14034a7d4', '2e503295-fb3f-4e12-a5db-03fafb56f45f'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-71747de5-1bbb-4cbf-83b6-08a5f8175861 tempest-VolumesCloneTest-1562120839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-71747de5-1bbb-4cbf-83b6-08a5f8175861 tempest-VolumesCloneTest-1562120839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-71747de5-1bbb-4cbf-83b6-08a5f8175861 tempest-VolumesCloneTest-1562120839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-71747de5-1bbb-4cbf-83b6-08a5f8175861 tempest-VolumesCloneTest-1562120839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-71747de5-1bbb-4cbf-83b6-08a5f8175861 tempest-VolumesCloneTest-1562120839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-71747de5-1bbb-4cbf-83b6-08a5f8175861 tempest-VolumesCloneTest-1562120839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:44 devstack sudo[100262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:59:44 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:44 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:44 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bfec7a6d-85b8-42c1-a1e3-aa4a4ef9cf78 tempest-ProjectReaderTests-1198497729 None] Acquiring lock "cinder-a84575c8-4c1e-43d2-a2b3-24faf5ba215b-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-71747de5-1bbb-4cbf-83b6-08a5f8175861 tempest-VolumesCloneTest-1562120839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.347s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f 1073741824" returned: 0 in 0.626s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-71747de5-1bbb-4cbf-83b6-08a5f8175861 tempest-VolumesCloneTest-1562120839 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:59:44 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-71747de5-1bbb-4cbf-83b6-08a5f8175861 tempest-VolumesCloneTest-1562120839 None] Deleted volume successfully.
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bfec7a6d-85b8-42c1-a1e3-aa4a4ef9cf78 tempest-ProjectReaderTests-1198497729 None] Lock "cinder-a84575c8-4c1e-43d2-a2b3-24faf5ba215b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-71747de5-1bbb-4cbf-83b6-08a5f8175861 tempest-VolumesCloneTest-1562120839 None] Lock "cinder-3371aae6-eae0-4627-a6ce-787b1c232a21-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:44 devstack sudo[100270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f
Sep 04 15:59:44 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bfec7a6d-85b8-42c1-a1e3-aa4a4ef9cf78 tempest-ProjectReaderTests-1198497729 None] Acquiring lock "cinder-quobyte-a84575c8-4c1e-43d2-a2b3-24faf5ba215b" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bfec7a6d-85b8-42c1-a1e3-aa4a4ef9cf78 tempest-ProjectReaderTests-1198497729 None] Lock "cinder-quobyte-a84575c8-4c1e-43d2-a2b3-24faf5ba215b" acquired by "delete_volume" :: waited 0.045s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1b25828f-47b9-4679-b5cc-2592b17bc0d1 tempest-VolumesCloneTest-1562120839 None] Acquiring lock "cinder-c4088239-c4a3-4250-8633-bf8c80fab4f1-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4447e91a-d799-4356-905f-943fd377ed0b]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bfec7a6d-85b8-42c1-a1e3-aa4a4ef9cf78 tempest-ProjectReaderTests-1198497729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a84575c8-4c1e-43d2-a2b3-24faf5ba215b {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-78b3698f-4c6f-4dfa-976f-0e4213d39ce2 tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1b25828f-47b9-4679-b5cc-2592b17bc0d1 tempest-VolumesCloneTest-1562120839 None] Lock "cinder-c4088239-c4a3-4250-8633-bf8c80fab4f1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1b25828f-47b9-4679-b5cc-2592b17bc0d1 tempest-VolumesCloneTest-1562120839 None] Acquiring lock "cinder-quobyte-c4088239-c4a3-4250-8633-bf8c80fab4f1" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1b25828f-47b9-4679-b5cc-2592b17bc0d1 tempest-VolumesCloneTest-1562120839 None] Lock "cinder-quobyte-c4088239-c4a3-4250-8633-bf8c80fab4f1" acquired by "delete_volume" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:44 devstack sudo[100272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a84575c8-4c1e-43d2-a2b3-24faf5ba215b
Sep 04 15:59:44 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:44 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f" returned: 0 in 0.303s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-78b3698f-4c6f-4dfa-976f-0e4213d39ce2 tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.153s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[09aa40b2-64bd-4f87-ae15-89d2eb941b99]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1b25828f-47b9-4679-b5cc-2592b17bc0d1 tempest-VolumesCloneTest-1562120839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990db1b6-1372-425d-809f-bd9a5ebf8455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d95ac72-a1a8-446e-b406-15157718a04f', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7089d254-ba06-44b8-8296-3153676088a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-78b3698f-4c6f-4dfa-976f-0e4213d39ce2 tempest-VolumesDeleteCascade-925960500 None] Creating offline snapshot d7a57a6a-50ef-4430-a48c-a8cfa40726d8 of volume a35f75f1-2411-45c7-a1e2-419bf0ac9f5a {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:59:44 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Volume volume-2d95ac72-a1a8-446e-b406-15157718a04f (2d95ac72-a1a8-446e-b406-15157718a04f): created successfully
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7089d254-ba06-44b8-8296-3153676088a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Flow 'volume_create_manager' (b105edda-1cb9-4092-8782-19ee25780eaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3509fe1-0b6e-453e-a353-5a4cf48d8e6b]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-78b3698f-4c6f-4dfa-976f-0e4213d39ce2 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:44 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-90c3d07f-3270-4b16-af4d-5822c57a8e43 tempest-VolumesSnapshotListTestJSON-385803983 None] Created volume successfully.
Sep 04 15:59:44 devstack sudo[100275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1
Sep 04 15:59:44 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:45 devstack sudo[100276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a
Sep 04 15:59:45 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:45 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bfec7a6d-85b8-42c1-a1e3-aa4a4ef9cf78 tempest-ProjectReaderTests-1198497729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a84575c8-4c1e-43d2-a2b3-24faf5ba215b" returned: 0 in 0.458s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bfec7a6d-85b8-42c1-a1e3-aa4a4ef9cf78 tempest-ProjectReaderTests-1198497729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a84575c8-4c1e-43d2-a2b3-24faf5ba215b {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:45 devstack sudo[100282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a84575c8-4c1e-43d2-a2b3-24faf5ba215b
Sep 04 15:59:45 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:45 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1b25828f-47b9-4679-b5cc-2592b17bc0d1 tempest-VolumesCloneTest-1562120839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1" returned: 0 in 0.422s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1b25828f-47b9-4679-b5cc-2592b17bc0d1 tempest-VolumesCloneTest-1562120839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:45 devstack sudo[100290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1
Sep 04 15:59:45 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:45 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-78b3698f-4c6f-4dfa-976f-0e4213d39ce2 tempest-VolumesDeleteCascade-925960500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a" returned: 0 in 0.452s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-78b3698f-4c6f-4dfa-976f-0e4213d39ce2 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:45 devstack sudo[100293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8 1G
Sep 04 15:59:45 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-81846c97-710d-4a0a-91ea-72ce7a7700de tempest-VolumesSnapshotListTestJSON-385803983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:45 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bfec7a6d-85b8-42c1-a1e3-aa4a4ef9cf78 tempest-ProjectReaderTests-1198497729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a84575c8-4c1e-43d2-a2b3-24faf5ba215b" returned: 0 in 0.335s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bfec7a6d-85b8-42c1-a1e3-aa4a4ef9cf78 tempest-ProjectReaderTests-1198497729 None] Lock "cinder-quobyte-a84575c8-4c1e-43d2-a2b3-24faf5ba215b" released by "delete_volume" :: held 0.868s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-bfec7a6d-85b8-42c1-a1e3-aa4a4ef9cf78 tempest-ProjectReaderTests-1198497729 None] Created reservations ['7c7278b3-5d6a-4f90-817e-5990ab0e0915', '5152a9af-af8f-40c6-abb0-5de66664caec', 'f633195a-e322-47da-b8e8-35d87c8bc2a5', '1df1538d-a8af-4823-bc7a-a5ed2665a1c9'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bfec7a6d-85b8-42c1-a1e3-aa4a4ef9cf78 tempest-ProjectReaderTests-1198497729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bfec7a6d-85b8-42c1-a1e3-aa4a4ef9cf78 tempest-ProjectReaderTests-1198497729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bfec7a6d-85b8-42c1-a1e3-aa4a4ef9cf78 tempest-ProjectReaderTests-1198497729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bfec7a6d-85b8-42c1-a1e3-aa4a4ef9cf78 tempest-ProjectReaderTests-1198497729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bfec7a6d-85b8-42c1-a1e3-aa4a4ef9cf78 tempest-ProjectReaderTests-1198497729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bfec7a6d-85b8-42c1-a1e3-aa4a4ef9cf78 tempest-ProjectReaderTests-1198497729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:45 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1b25828f-47b9-4679-b5cc-2592b17bc0d1 tempest-VolumesCloneTest-1562120839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c4088239-c4a3-4250-8633-bf8c80fab4f1" returned: 0 in 0.421s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:45 devstack sudo[100300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:59:45 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1b25828f-47b9-4679-b5cc-2592b17bc0d1 tempest-VolumesCloneTest-1562120839 None] Lock "cinder-quobyte-c4088239-c4a3-4250-8633-bf8c80fab4f1" released by "delete_volume" :: held 0.929s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-1b25828f-47b9-4679-b5cc-2592b17bc0d1 tempest-VolumesCloneTest-1562120839 None] Created reservations ['0e258a0a-b71e-4a49-a622-b481498027cb', 'd5e2e6e5-7ff6-447a-b377-e77eba268107', '94bd2c65-5ff8-4ce7-9a31-ea124541a8ed', 'e3a7b24e-5155-4cb8-bb0f-aef65608be2d'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1b25828f-47b9-4679-b5cc-2592b17bc0d1 tempest-VolumesCloneTest-1562120839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1b25828f-47b9-4679-b5cc-2592b17bc0d1 tempest-VolumesCloneTest-1562120839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1b25828f-47b9-4679-b5cc-2592b17bc0d1 tempest-VolumesCloneTest-1562120839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1b25828f-47b9-4679-b5cc-2592b17bc0d1 tempest-VolumesCloneTest-1562120839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1b25828f-47b9-4679-b5cc-2592b17bc0d1 tempest-VolumesCloneTest-1562120839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1b25828f-47b9-4679-b5cc-2592b17bc0d1 tempest-VolumesCloneTest-1562120839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:45 devstack sudo[100302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:59:45 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:45 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-78b3698f-4c6f-4dfa-976f-0e4213d39ce2 tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8 1G" returned: 0 in 0.577s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-78b3698f-4c6f-4dfa-976f-0e4213d39ce2 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:46 devstack sudo[100304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8
Sep 04 15:59:46 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:46 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bfec7a6d-85b8-42c1-a1e3-aa4a4ef9cf78 tempest-ProjectReaderTests-1198497729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.384s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:46 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-bfec7a6d-85b8-42c1-a1e3-aa4a4ef9cf78 tempest-ProjectReaderTests-1198497729 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:59:46 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-bfec7a6d-85b8-42c1-a1e3-aa4a4ef9cf78 tempest-ProjectReaderTests-1198497729 None] Deleted volume successfully.
Sep 04 15:59:46 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bfec7a6d-85b8-42c1-a1e3-aa4a4ef9cf78 tempest-ProjectReaderTests-1198497729 None] Lock "cinder-a84575c8-4c1e-43d2-a2b3-24faf5ba215b-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:46 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1b25828f-47b9-4679-b5cc-2592b17bc0d1 tempest-VolumesCloneTest-1562120839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.329s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:46 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-1b25828f-47b9-4679-b5cc-2592b17bc0d1 tempest-VolumesCloneTest-1562120839 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:59:46 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-1b25828f-47b9-4679-b5cc-2592b17bc0d1 tempest-VolumesCloneTest-1562120839 None] Deleted volume successfully.
Sep 04 15:59:46 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1b25828f-47b9-4679-b5cc-2592b17bc0d1 tempest-VolumesCloneTest-1562120839 None] Lock "cinder-c4088239-c4a3-4250-8633-bf8c80fab4f1-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:46 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-78b3698f-4c6f-4dfa-976f-0e4213d39ce2 tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8" returned: 0 in 0.381s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:46 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-78b3698f-4c6f-4dfa-976f-0e4213d39ce2 tempest-VolumesDeleteCascade-925960500 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8 is being set with open permissions: ugo+rw
Sep 04 15:59:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-78b3698f-4c6f-4dfa-976f-0e4213d39ce2 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:46 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:59:46 devstack sudo[100311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8
Sep 04 15:59:46 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Flow 'volume_create_manager' (fc64db2d-c524-4bc1-94e3-3444d973bf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9961412-cbbc-49d1-b1ca-efcac244dc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9961412-cbbc-49d1-b1ca-efcac244dc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-800624539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7135a1d1-f0c0-4f9b-911d-8eaf262ab300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeba0df0bcae42f1aef552a70bfa3f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:46Z,use_quota=True,user_id='6baf269a6e88436abae71b49792cb470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79107361-0754-4356-9e8a-c832e361d827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79107361-0754-4356-9e8a-c832e361d827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2015d3ba-d720-4a9c-8036-81c5fd412d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2015d3ba-d720-4a9c-8036-81c5fd412d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7135a1d1-f0c0-4f9b-911d-8eaf262ab300', 'volume_name': 'volume-7135a1d1-f0c0-4f9b-911d-8eaf262ab300', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f23bc5d7-cbff-4d73-aa18-9da9e985c28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f23bc5d7-cbff-4d73-aa18-9da9e985c28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86964583-3cb4-401a-805c-b147caa3e08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:46 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Volume 7135a1d1-f0c0-4f9b-911d-8eaf262ab300: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7135a1d1-f0c0-4f9b-911d-8eaf262ab300', 'volume_size': 1}
Sep 04 15:59:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:46 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-78b3698f-4c6f-4dfa-976f-0e4213d39ce2 tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8" returned: 0 in 0.274s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-78b3698f-4c6f-4dfa-976f-0e4213d39ce2 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:46 devstack sudo[100314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.info
Sep 04 15:59:46 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:46 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-78b3698f-4c6f-4dfa-976f-0e4213d39ce2 tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.info" returned: 0 in 0.243s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:46 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-78b3698f-4c6f-4dfa-976f-0e4213d39ce2 tempest-VolumesDeleteCascade-925960500 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.info is being set with open permissions: ugo+rw
Sep 04 15:59:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-78b3698f-4c6f-4dfa-976f-0e4213d39ce2 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:46 devstack sudo[100317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.info
Sep 04 15:59:46 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:47 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-78b3698f-4c6f-4dfa-976f-0e4213d39ce2 tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.info" returned: 0 in 0.286s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-78b3698f-4c6f-4dfa-976f-0e4213d39ce2 tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.353s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-81846c97-710d-4a0a-91ea-72ce7a7700de tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.764s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:47 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:UPDATE=247,cinder:SELECT=179,cinder:INSERT=61,cinder:DELETE=16 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:59:47 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=176,cinder:INSERT=66,cinder:UPDATE=222,cinder:DELETE=24 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 15:59:47 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-81846c97-710d-4a0a-91ea-72ce7a7700de tempest-VolumesSnapshotListTestJSON-385803983 None] Creating offline snapshot 2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371 of volume 2d95ac72-a1a8-446e-b406-15157718a04f {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:59:47 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-78b3698f-4c6f-4dfa-976f-0e4213d39ce2 tempest-VolumesDeleteCascade-925960500 None] Create snapshot completed successfully
Sep 04 15:59:47 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f3af5e-abb9-4049-94e4-dab3559f0923]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81846c97-710d-4a0a-91ea-72ce7a7700de tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:47 devstack sudo[100320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f
Sep 04 15:59:47 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:47 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81846c97-710d-4a0a-91ea-72ce7a7700de tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f" returned: 0 in 0.459s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81846c97-710d-4a0a-91ea-72ce7a7700de tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:47 devstack sudo[100325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371 1G
Sep 04 15:59:47 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c0d25453-061e-4e72-9c48-0a664b1520d8 tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:48 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81846c97-710d-4a0a-91ea-72ce7a7700de tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371 1G" returned: 0 in 0.465s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81846c97-710d-4a0a-91ea-72ce7a7700de tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d95ac72-a1a8-446e-b406-15157718a04f -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:48 devstack sudo[100331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d95ac72-a1a8-446e-b406-15157718a04f -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371
Sep 04 15:59:48 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:48 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81846c97-710d-4a0a-91ea-72ce7a7700de tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d95ac72-a1a8-446e-b406-15157718a04f -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371" returned: 0 in 0.332s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:48 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-81846c97-710d-4a0a-91ea-72ce7a7700de tempest-VolumesSnapshotListTestJSON-385803983 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371 is being set with open permissions: ugo+rw
Sep 04 15:59:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81846c97-710d-4a0a-91ea-72ce7a7700de tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:48 devstack sudo[100336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371
Sep 04 15:59:48 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:48 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81846c97-710d-4a0a-91ea-72ce7a7700de tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371" returned: 0 in 0.245s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81846c97-710d-4a0a-91ea-72ce7a7700de tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:48 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:59:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:48 devstack sudo[100339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.info
Sep 04 15:59:48 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:48 devstack sudo[100340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:59:48 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:49 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81846c97-710d-4a0a-91ea-72ce7a7700de tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.info" returned: 0 in 0.267s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:49 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-81846c97-710d-4a0a-91ea-72ce7a7700de tempest-VolumesSnapshotListTestJSON-385803983 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.info is being set with open permissions: ugo+rw
Sep 04 15:59:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81846c97-710d-4a0a-91ea-72ce7a7700de tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:49 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.263s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:49 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:59:49 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager._thread_info {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 15:59:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread count: 28 {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 15:59:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread info: [<_MainThread(MainThread, started 131673838448768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131673724603200)>, <Thread(Thread-3 (stat_writer), started daemon 131673723495936)>, <Thread(Rabbit-heartbeat, started daemon 131673723764800)>, <Thread(Thread-5 (_runner), started daemon 131673722269632)>, <Thread(Thread-7 (_runner), started daemon 131673722322112)>, <Thread(fd_logger, started daemon 131673722585024)>, <Thread(privsep_reader, started daemon 131673721593984)>, <Thread(tpool_thread_0, started daemon 131673714706112)>, <Thread(tpool_thread_1, started daemon 131673706313408)>, <Thread(tpool_thread_2, started daemon 131673697920704)>, <Thread(tpool_thread_3, started daemon 131673689528000)>, <Thread(tpool_thread_4, started daemon 131673681135296)>, <Thread(tpool_thread_5, started daemon 131673672726208)>, <Thread(tpool_thread_6, started daemon 131673664317120)>, <Thread(tpool_thread_7, started daemon 131673655908032)>, <Thread(tpool_thread_8, started daemon 131673647498944)>, <Thread(tpool_thread_9, started daemon 131673639089856)>, <Thread(tpool_thread_10, started daemon 131673630680768)>, <Thread(tpool_thread_11, started daemon 131673622271680)>, <Thread(tpool_thread_12, started daemon 131673613862592)>, <Thread(tpool_thread_13, started daemon 131673605453504)>, <Thread(tpool_thread_14, started daemon 131673597044416)>, <Thread(tpool_thread_15, started daemon 131673588635328)>, <Thread(tpool_thread_16, started daemon 131673580226240)>, <Thread(tpool_thread_17, started daemon 131673571817152)>, <Thread(tpool_thread_18, started daemon 131673563408064)>, <Thread(tpool_thread_19, started daemon 131673554998976)>] {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 15:59:49 devstack sudo[100345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.info
Sep 04 15:59:49 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:49 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81846c97-710d-4a0a-91ea-72ce7a7700de tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.info" returned: 0 in 0.248s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-81846c97-710d-4a0a-91ea-72ce7a7700de tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.123s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.864s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-800624539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7135a1d1-f0c0-4f9b-911d-8eaf262ab300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeba0df0bcae42f1aef552a70bfa3f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:46Z,use_quota=True,user_id='6baf269a6e88436abae71b49792cb470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:59:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Creating volume 7135a1d1-f0c0-4f9b-911d-8eaf262ab300 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:59:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:59:49 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:59:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7135a1d1-f0c0-4f9b-911d-8eaf262ab300 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:49 devstack sudo[100348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7135a1d1-f0c0-4f9b-911d-8eaf262ab300 1073741824
Sep 04 15:59:49 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:49 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-81846c97-710d-4a0a-91ea-72ce7a7700de tempest-VolumesSnapshotListTestJSON-385803983 None] Create snapshot completed successfully
Sep 04 15:59:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e548651a-4d0b-4a25-bee8-5226b161a277 tempest-VolumesSnapshotListTestJSON-385803983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:49 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7135a1d1-f0c0-4f9b-911d-8eaf262ab300 1073741824" returned: 0 in 0.516s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7135a1d1-f0c0-4f9b-911d-8eaf262ab300 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:49 devstack sudo[100354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7135a1d1-f0c0-4f9b-911d-8eaf262ab300
Sep 04 15:59:49 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:59:50 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Flow 'volume_create_manager' (2ab8ae50-3608-4afc-b93b-5f52d44fabde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70178ea-62b1-48bf-a0e6-f5aa7c18414a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7135a1d1-f0c0-4f9b-911d-8eaf262ab300" returned: 0 in 0.294s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c0d25453-061e-4e72-9c48-0a664b1520d8 tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.150s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70178ea-62b1-48bf-a0e6-f5aa7c18414a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2002756213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b364fff6-49e7-4011-a026-6534873795f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b01a6cdd2f4d8eaaba379ec82041e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:50Z,use_quota=True,user_id='9c771ef55b264988a29a3c3f05bd04bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa5d63eb-a414-44aa-a44a-2368dd2b6a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa5d63eb-a414-44aa-a44a-2368dd2b6a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ecf4487-6e4c-4103-b99e-aab5011e8ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ecf4487-6e4c-4103-b99e-aab5011e8ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b364fff6-49e7-4011-a026-6534873795f0', 'volume_name': 'volume-b364fff6-49e7-4011-a026-6534873795f0', 'volume_size': 2}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94160758-69be-4226-97dd-b6f82b50cc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94160758-69be-4226-97dd-b6f82b50cc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412bc691-e714-4075-8f78-f846bae43563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:50 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Volume b364fff6-49e7-4011-a026-6534873795f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b364fff6-49e7-4011-a026-6534873795f0', 'volume_size': 2}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86964583-3cb4-401a-805c-b147caa3e08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7135a1d1-f0c0-4f9b-911d-8eaf262ab300', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8d9a600-4927-4a6f-b3b8-d59132837515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-c0d25453-061e-4e72-9c48-0a664b1520d8 tempest-VolumesDeleteCascade-925960500 None] Creating offline snapshot cf4a9701-17c0-4e00-8e5e-c24dda836eaf of volume a35f75f1-2411-45c7-a1e2-419bf0ac9f5a {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:59:50 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Volume volume-7135a1d1-f0c0-4f9b-911d-8eaf262ab300 (7135a1d1-f0c0-4f9b-911d-8eaf262ab300): created successfully
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8d9a600-4927-4a6f-b3b8-d59132837515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Flow 'volume_create_manager' (fc64db2d-c524-4bc1-94e3-3444d973bf75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb40793-8058-4849-a15c-67eca770e557]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c0d25453-061e-4e72-9c48-0a664b1520d8 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:50 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f7a9c53c-9539-4cc7-af52-f6b3f577462b tempest-ProjectReaderTests-1198497729 None] Created volume successfully.
Sep 04 15:59:50 devstack sudo[100358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8
Sep 04 15:59:50 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4f7ab36d-42cf-44f0-83b3-c1881a7ff97a tempest-ProjectReaderTests-1198497729 None] Acquiring lock "cinder-7135a1d1-f0c0-4f9b-911d-8eaf262ab300-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:50 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c0d25453-061e-4e72-9c48-0a664b1520d8 tempest-VolumesDeleteCascade-925960500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8" returned: 0 in 0.392s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-c0d25453-061e-4e72-9c48-0a664b1520d8 tempest-VolumesDeleteCascade-925960500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c0d25453-061e-4e72-9c48-0a664b1520d8 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.cf4a9701-17c0-4e00-8e5e-c24dda836eaf 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4f7ab36d-42cf-44f0-83b3-c1881a7ff97a tempest-ProjectReaderTests-1198497729 None] Lock "cinder-7135a1d1-f0c0-4f9b-911d-8eaf262ab300-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:50 devstack sudo[100363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.cf4a9701-17c0-4e00-8e5e-c24dda836eaf 1G
Sep 04 15:59:50 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4f7ab36d-42cf-44f0-83b3-c1881a7ff97a tempest-ProjectReaderTests-1198497729 None] Acquiring lock "cinder-quobyte-7135a1d1-f0c0-4f9b-911d-8eaf262ab300" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4f7ab36d-42cf-44f0-83b3-c1881a7ff97a tempest-ProjectReaderTests-1198497729 None] Lock "cinder-quobyte-7135a1d1-f0c0-4f9b-911d-8eaf262ab300" acquired by "delete_volume" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfa031f-921f-41af-b274-17612e136582]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4f7ab36d-42cf-44f0-83b3-c1881a7ff97a tempest-ProjectReaderTests-1198497729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7135a1d1-f0c0-4f9b-911d-8eaf262ab300 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:50 devstack sudo[100365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7135a1d1-f0c0-4f9b-911d-8eaf262ab300
Sep 04 15:59:50 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:51 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c0d25453-061e-4e72-9c48-0a664b1520d8 tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.cf4a9701-17c0-4e00-8e5e-c24dda836eaf 1G" returned: 0 in 0.485s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c0d25453-061e-4e72-9c48-0a664b1520d8 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.cf4a9701-17c0-4e00-8e5e-c24dda836eaf {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:51 devstack sudo[100374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.cf4a9701-17c0-4e00-8e5e-c24dda836eaf
Sep 04 15:59:51 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:51 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4f7ab36d-42cf-44f0-83b3-c1881a7ff97a tempest-ProjectReaderTests-1198497729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7135a1d1-f0c0-4f9b-911d-8eaf262ab300" returned: 0 in 0.426s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4f7ab36d-42cf-44f0-83b3-c1881a7ff97a tempest-ProjectReaderTests-1198497729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7135a1d1-f0c0-4f9b-911d-8eaf262ab300 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:51 devstack sudo[100376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7135a1d1-f0c0-4f9b-911d-8eaf262ab300
Sep 04 15:59:51 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:51 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c0d25453-061e-4e72-9c48-0a664b1520d8 tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.cf4a9701-17c0-4e00-8e5e-c24dda836eaf" returned: 0 in 0.283s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:51 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-c0d25453-061e-4e72-9c48-0a664b1520d8 tempest-VolumesDeleteCascade-925960500 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.cf4a9701-17c0-4e00-8e5e-c24dda836eaf is being set with open permissions: ugo+rw
Sep 04 15:59:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c0d25453-061e-4e72-9c48-0a664b1520d8 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.cf4a9701-17c0-4e00-8e5e-c24dda836eaf {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:51 devstack sudo[100382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.cf4a9701-17c0-4e00-8e5e-c24dda836eaf
Sep 04 15:59:51 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:51 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4f7ab36d-42cf-44f0-83b3-c1881a7ff97a tempest-ProjectReaderTests-1198497729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7135a1d1-f0c0-4f9b-911d-8eaf262ab300" returned: 0 in 0.297s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4f7ab36d-42cf-44f0-83b3-c1881a7ff97a tempest-ProjectReaderTests-1198497729 None] Lock "cinder-quobyte-7135a1d1-f0c0-4f9b-911d-8eaf262ab300" released by "delete_volume" :: held 0.770s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:51 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-4f7ab36d-42cf-44f0-83b3-c1881a7ff97a tempest-ProjectReaderTests-1198497729 None] Created reservations ['ef2c1d75-a861-485d-b340-d1e7365babe6', 'a86152e6-89fe-4148-bb09-586447b839e1', '8b45ca6e-a2f3-4f8c-a730-94f96ac452c4', '81d34eca-bd0d-4cbc-b187-f8413142cd9c'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:59:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4f7ab36d-42cf-44f0-83b3-c1881a7ff97a tempest-ProjectReaderTests-1198497729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4f7ab36d-42cf-44f0-83b3-c1881a7ff97a tempest-ProjectReaderTests-1198497729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:51 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4f7ab36d-42cf-44f0-83b3-c1881a7ff97a tempest-ProjectReaderTests-1198497729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:51 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:51 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4f7ab36d-42cf-44f0-83b3-c1881a7ff97a tempest-ProjectReaderTests-1198497729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4f7ab36d-42cf-44f0-83b3-c1881a7ff97a tempest-ProjectReaderTests-1198497729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4f7ab36d-42cf-44f0-83b3-c1881a7ff97a tempest-ProjectReaderTests-1198497729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c0d25453-061e-4e72-9c48-0a664b1520d8 tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.cf4a9701-17c0-4e00-8e5e-c24dda836eaf" returned: 0 in 0.272s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:51 devstack sudo[100385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:59:51 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c0d25453-061e-4e72-9c48-0a664b1520d8 tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.623s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e548651a-4d0b-4a25-bee8-5226b161a277 tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.051s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:51 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-e548651a-4d0b-4a25-bee8-5226b161a277 tempest-VolumesSnapshotListTestJSON-385803983 None] Creating offline snapshot 5f6e2fca-482c-47f2-bece-8b506bbf45de of volume 2d95ac72-a1a8-446e-b406-15157718a04f {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:59:51 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-c0d25453-061e-4e72-9c48-0a664b1520d8 tempest-VolumesDeleteCascade-925960500 None] Create snapshot completed successfully
Sep 04 15:59:51 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cad512-ff35-463f-978e-77336b6425ff]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e548651a-4d0b-4a25-bee8-5226b161a277 tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:52 devstack sudo[100387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371
Sep 04 15:59:52 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:52 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4f7ab36d-42cf-44f0-83b3-c1881a7ff97a tempest-ProjectReaderTests-1198497729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.336s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-4f7ab36d-42cf-44f0-83b3-c1881a7ff97a tempest-ProjectReaderTests-1198497729 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:59:52 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-4f7ab36d-42cf-44f0-83b3-c1881a7ff97a tempest-ProjectReaderTests-1198497729 None] Deleted volume successfully.
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4f7ab36d-42cf-44f0-83b3-c1881a7ff97a tempest-ProjectReaderTests-1198497729 None] Lock "cinder-7135a1d1-f0c0-4f9b-911d-8eaf262ab300-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "cinder-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Performing cascade delete. {{(pid=87504) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 04 15:59:52 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "cinder-cf4a9701-17c0-4e00-8e5e-c24dda836eaf-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e548651a-4d0b-4a25-bee8-5226b161a277 tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371" returned: 0 in 0.568s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-e548651a-4d0b-4a25-bee8-5226b161a277 tempest-VolumesSnapshotListTestJSON-385803983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d95ac72-a1a8-446e-b406-15157718a04f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e548651a-4d0b-4a25-bee8-5226b161a277 tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-cf4a9701-17c0-4e00-8e5e-c24dda836eaf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:52 devstack sudo[100393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de 1G
Sep 04 15:59:52 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "cinder-quobyte-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-quobyte-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "cinder-quobyte-cf4a9701-17c0-4e00-8e5e-c24dda836eaf" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-quobyte-cf4a9701-17c0-4e00-8e5e-c24dda836eaf" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Deleting offline snapshot cf4a9701-17c0-4e00-8e5e-c24dda836eaf of volume a35f75f1-2411-45c7-a1e2-419bf0ac9f5a {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] snapshot_file for this snap is: volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.cf4a9701-17c0-4e00-8e5e-c24dda836eaf {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[900da96b-0ef5-4f07-8ece-7e3b0ca08751]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.cf4a9701-17c0-4e00-8e5e-c24dda836eaf {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Flow 'volume_create_manager' (f604568d-23ba-41d1-8a4a-1fce56d39191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467fb188-e0db-44de-ba8d-ded2fbc449aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467fb188-e0db-44de-ba8d-ded2fbc449aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-85477044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b381124-2bc1-4d7f-8c30-9d92296e769c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeba0df0bcae42f1aef552a70bfa3f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:53Z,use_quota=True,user_id='6baf269a6e88436abae71b49792cb470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80af0389-123f-403c-9c33-04f98e113d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80af0389-123f-403c-9c33-04f98e113d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb79201c-7200-44e4-8d2c-6605bab7f300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb79201c-7200-44e4-8d2c-6605bab7f300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b381124-2bc1-4d7f-8c30-9d92296e769c', 'volume_name': 'volume-9b381124-2bc1-4d7f-8c30-9d92296e769c', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e372170a-d8ff-4cf9-9476-483d78a00c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e372170a-d8ff-4cf9-9476-483d78a00c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (076c2f34-6abb-430a-a589-ce3fd341bf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:52 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Volume 9b381124-2bc1-4d7f-8c30-9d92296e769c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b381124-2bc1-4d7f-8c30-9d92296e769c', 'volume_size': 1}
Sep 04 15:59:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:52 devstack sudo[100395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.cf4a9701-17c0-4e00-8e5e-c24dda836eaf
Sep 04 15:59:52 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:53 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:53 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.cf4a9701-17c0-4e00-8e5e-c24dda836eaf" returned: 0 in 0.393s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:59:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e548651a-4d0b-4a25-bee8-5226b161a277 tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de 1G" returned: 0 in 0.561s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e548651a-4d0b-4a25-bee8-5226b161a277 tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:53 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[12688c87-d60d-429b-9a93-d11293af3a0d]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:53 devstack sudo[100403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de
Sep 04 15:59:53 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:53 devstack sudo[100404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8
Sep 04 15:59:53 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:53 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e548651a-4d0b-4a25-bee8-5226b161a277 tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de" returned: 0 in 0.346s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:53 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-e548651a-4d0b-4a25-bee8-5226b161a277 tempest-VolumesSnapshotListTestJSON-385803983 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de is being set with open permissions: ugo+rw
Sep 04 15:59:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e548651a-4d0b-4a25-bee8-5226b161a277 tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:53 devstack sudo[100413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de
Sep 04 15:59:53 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:53 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8" returned: 0 in 0.383s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:59:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.cf4a9701-17c0-4e00-8e5e-c24dda836eaf {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:53 devstack sudo[100415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.cf4a9701-17c0-4e00-8e5e-c24dda836eaf
Sep 04 15:59:53 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:53 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e548651a-4d0b-4a25-bee8-5226b161a277 tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de" returned: 0 in 0.298s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e548651a-4d0b-4a25-bee8-5226b161a277 tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.896s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.480s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2002756213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b364fff6-49e7-4011-a026-6534873795f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b01a6cdd2f4d8eaaba379ec82041e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:50Z,use_quota=True,user_id='9c771ef55b264988a29a3c3f05bd04bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:59:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Creating volume b364fff6-49e7-4011-a026-6534873795f0 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:59:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:59:53 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:59:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b364fff6-49e7-4011-a026-6534873795f0 2147483648 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:53 devstack sudo[100422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b364fff6-49e7-4011-a026-6534873795f0 2147483648
Sep 04 15:59:53 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:53 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e548651a-4d0b-4a25-bee8-5226b161a277 tempest-VolumesSnapshotListTestJSON-385803983 None] Create snapshot completed successfully
Sep 04 15:59:53 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.cf4a9701-17c0-4e00-8e5e-c24dda836eaf" returned: 0 in 0.430s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.cf4a9701-17c0-4e00-8e5e-c24dda836eaf {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:53 devstack sudo[100424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.cf4a9701-17c0-4e00-8e5e-c24dda836eaf
Sep 04 15:59:53 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-561294dc-fa0c-4048-bd14-da85f4894790 tempest-VolumesSnapshotListTestJSON-385803983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:54 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.cf4a9701-17c0-4e00-8e5e-c24dda836eaf" returned: 0 in 0.358s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-quobyte-cf4a9701-17c0-4e00-8e5e-c24dda836eaf" released by "_delete_snapshot" :: held 1.671s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-quobyte-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a" released by "delete_snapshot" :: held 1.708s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:54 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b364fff6-49e7-4011-a026-6534873795f0 2147483648" returned: 0 in 0.595s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Created reservations ['494f88fa-1856-45e1-b433-0d4b18ec3a77', '95cfc3e7-029d-46ef-b33c-e78b01362e0c', 'c32ea59e-968d-449d-aa39-a7850acdf90d', '2bbe230b-84c5-4c17-82f5-6e2c9f5654b0'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b364fff6-49e7-4011-a026-6534873795f0 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:54 devstack sudo[100432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b364fff6-49e7-4011-a026-6534873795f0
Sep 04 15:59:54 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:54 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Delete snapshot completed successfully.
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-cf4a9701-17c0-4e00-8e5e-c24dda836eaf-delete_snapshot" released by "delete_snapshot" :: held 1.926s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "cinder-d7a57a6a-50ef-4430-a48c-a8cfa40726d8-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-d7a57a6a-50ef-4430-a48c-a8cfa40726d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "cinder-quobyte-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-quobyte-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "cinder-quobyte-d7a57a6a-50ef-4430-a48c-a8cfa40726d8" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-quobyte-d7a57a6a-50ef-4430-a48c-a8cfa40726d8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Deleting offline snapshot d7a57a6a-50ef-4430-a48c-a8cfa40726d8 of volume a35f75f1-2411-45c7-a1e2-419bf0ac9f5a {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] snapshot_file for this snap is: volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e031967-00fe-458e-a750-6a75326c3c18]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:54 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b364fff6-49e7-4011-a026-6534873795f0" returned: 0 in 0.286s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.923s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-85477044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b381124-2bc1-4d7f-8c30-9d92296e769c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeba0df0bcae42f1aef552a70bfa3f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:53Z,use_quota=True,user_id='6baf269a6e88436abae71b49792cb470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Creating volume 9b381124-2bc1-4d7f-8c30-9d92296e769c {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:59:54 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b381124-2bc1-4d7f-8c30-9d92296e769c 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:54 devstack sudo[100436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b381124-2bc1-4d7f-8c30-9d92296e769c 1073741824
Sep 04 15:59:54 devstack sudo[100434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8
Sep 04 15:59:54 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:54 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412bc691-e714-4075-8f78-f846bae43563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b364fff6-49e7-4011-a026-6534873795f0', 'volume_size': 2}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c8d246-2bae-4f79-8543-eb665413832a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:54 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Volume volume-b364fff6-49e7-4011-a026-6534873795f0 (b364fff6-49e7-4011-a026-6534873795f0): created successfully
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c8d246-2bae-4f79-8543-eb665413832a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Flow 'volume_create_manager' (2ab8ae50-3608-4afc-b93b-5f52d44fabde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:54 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-1292d835-6e56-42f7-894d-1b8a27128117 tempest-VolumesCloneNegativeTest-1878301721 None] Created volume successfully.
Sep 04 15:59:54 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8" returned: 0 in 0.417s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:59:55 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ed7652-a739-40dd-9d1d-a098cd1d859b]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:55 devstack sudo[100445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a
Sep 04 15:59:55 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:55 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b381124-2bc1-4d7f-8c30-9d92296e769c 1073741824" returned: 0 in 0.504s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b381124-2bc1-4d7f-8c30-9d92296e769c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:55 devstack sudo[100448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b381124-2bc1-4d7f-8c30-9d92296e769c
Sep 04 15:59:55 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:55 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a" returned: 0 in 0.433s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:55 devstack sudo[100454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8
Sep 04 15:59:55 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:55 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b381124-2bc1-4d7f-8c30-9d92296e769c" returned: 0 in 0.267s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 15:59:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-561294dc-fa0c-4048-bd14-da85f4894790 tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.304s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (076c2f34-6abb-430a-a589-ce3fd341bf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b381124-2bc1-4d7f-8c30-9d92296e769c', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0732d2a9-2eda-4c7d-a05f-21f1b67dab8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-561294dc-fa0c-4048-bd14-da85f4894790 tempest-VolumesSnapshotListTestJSON-385803983 None] Creating offline snapshot 8ed22fda-6c5d-4713-ab45-28a7324fb9e8 of volume 2d95ac72-a1a8-446e-b406-15157718a04f {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 15:59:55 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Volume volume-9b381124-2bc1-4d7f-8c30-9d92296e769c (9b381124-2bc1-4d7f-8c30-9d92296e769c): created successfully
Sep 04 15:59:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0732d2a9-2eda-4c7d-a05f-21f1b67dab8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:55 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Flow 'volume_create_manager' (f604568d-23ba-41d1-8a4a-1fce56d39191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:55 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b15ef4-0caf-486c-ab0e-fc7618e7c488]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-561294dc-fa0c-4048-bd14-da85f4894790 tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:55 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-c777bc66-4bbe-4de2-ba20-6ffd4e514888 tempest-ProjectReaderTests-1198497729 None] Created volume successfully.
Sep 04 15:59:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b9848c6a-3366-46e1-b1c8-7adce717a8d9 tempest-VolumesCloneNegativeTest-1878301721 None] Acquiring lock "cinder-b364fff6-49e7-4011-a026-6534873795f0-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b9848c6a-3366-46e1-b1c8-7adce717a8d9 tempest-VolumesCloneNegativeTest-1878301721 None] Lock "cinder-b364fff6-49e7-4011-a026-6534873795f0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:55 devstack sudo[100456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de
Sep 04 15:59:55 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b9848c6a-3366-46e1-b1c8-7adce717a8d9 tempest-VolumesCloneNegativeTest-1878301721 None] Acquiring lock "cinder-quobyte-b364fff6-49e7-4011-a026-6534873795f0" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b9848c6a-3366-46e1-b1c8-7adce717a8d9 tempest-VolumesCloneNegativeTest-1878301721 None] Lock "cinder-quobyte-b364fff6-49e7-4011-a026-6534873795f0" acquired by "delete_volume" :: waited 0.029s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:55 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98bbf06-da59-4902-8246-5e13b49a1aa1]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b9848c6a-3366-46e1-b1c8-7adce717a8d9 tempest-VolumesCloneNegativeTest-1878301721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b364fff6-49e7-4011-a026-6534873795f0 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:55 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8" returned: 0 in 0.455s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:55 devstack sudo[100462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8
Sep 04 15:59:55 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:55 devstack sudo[100461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b364fff6-49e7-4011-a026-6534873795f0
Sep 04 15:59:55 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:56 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-561294dc-fa0c-4048-bd14-da85f4894790 tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de" returned: 0 in 0.509s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-561294dc-fa0c-4048-bd14-da85f4894790 tempest-VolumesSnapshotListTestJSON-385803983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d95ac72-a1a8-446e-b406-15157718a04f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-561294dc-fa0c-4048-bd14-da85f4894790 tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.8ed22fda-6c5d-4713-ab45-28a7324fb9e8 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:56 devstack sudo[100469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.8ed22fda-6c5d-4713-ab45-28a7324fb9e8 1G
Sep 04 15:59:56 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:56 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-646d15e1-967e-4465-a7a2-050125cbd12a tempest-ProjectReaderTests-1198497729 None] Acquiring lock "cinder-9b381124-2bc1-4d7f-8c30-9d92296e769c-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a.d7a57a6a-50ef-4430-a48c-a8cfa40726d8" returned: 0 in 0.340s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-quobyte-d7a57a6a-50ef-4430-a48c-a8cfa40726d8" released by "_delete_snapshot" :: held 1.794s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-646d15e1-967e-4465-a7a2-050125cbd12a tempest-ProjectReaderTests-1198497729 None] Lock "cinder-9b381124-2bc1-4d7f-8c30-9d92296e769c-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-quobyte-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a" released by "delete_snapshot" :: held 1.829s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:56 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b9848c6a-3366-46e1-b1c8-7adce717a8d9 tempest-VolumesCloneNegativeTest-1878301721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b364fff6-49e7-4011-a026-6534873795f0" returned: 0 in 0.488s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b9848c6a-3366-46e1-b1c8-7adce717a8d9 tempest-VolumesCloneNegativeTest-1878301721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b364fff6-49e7-4011-a026-6534873795f0 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:56 devstack sudo[100475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b364fff6-49e7-4011-a026-6534873795f0
Sep 04 15:59:56 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-646d15e1-967e-4465-a7a2-050125cbd12a tempest-ProjectReaderTests-1198497729 None] Acquiring lock "cinder-quobyte-9b381124-2bc1-4d7f-8c30-9d92296e769c" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-646d15e1-967e-4465-a7a2-050125cbd12a tempest-ProjectReaderTests-1198497729 None] Lock "cinder-quobyte-9b381124-2bc1-4d7f-8c30-9d92296e769c" acquired by "delete_volume" :: waited 0.030s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Created reservations ['ee411937-6fbd-4ee4-8e22-24302261ad51', '54045adb-3773-4247-b6c8-66b44107f8a3', '77ec434e-2044-43f7-ac07-eef06d99db8d', '912c234c-e218-4067-bb20-dd64cd51ed54'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05250c0-1992-424b-aed7-6d498560dac6]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-646d15e1-967e-4465-a7a2-050125cbd12a tempest-ProjectReaderTests-1198497729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b381124-2bc1-4d7f-8c30-9d92296e769c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:56 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Delete snapshot completed successfully.
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-d7a57a6a-50ef-4430-a48c-a8cfa40726d8-delete_snapshot" released by "delete_snapshot" :: held 2.075s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Snapshots deleted, issuing volume delete {{(pid=87504) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "cinder-quobyte-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-quobyte-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a" acquired by "delete_volume" :: waited 0.021s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:56 devstack sudo[100479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b381124-2bc1-4d7f-8c30-9d92296e769c
Sep 04 15:59:56 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d529c8-26df-4f87-a4c5-dcffb5835c7b]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:56 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b9848c6a-3366-46e1-b1c8-7adce717a8d9 tempest-VolumesCloneNegativeTest-1878301721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b364fff6-49e7-4011-a026-6534873795f0" returned: 0 in 0.318s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b9848c6a-3366-46e1-b1c8-7adce717a8d9 tempest-VolumesCloneNegativeTest-1878301721 None] Lock "cinder-quobyte-b364fff6-49e7-4011-a026-6534873795f0" released by "delete_volume" :: held 0.849s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:56 devstack sudo[100484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a
Sep 04 15:59:56 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-b9848c6a-3366-46e1-b1c8-7adce717a8d9 tempest-VolumesCloneNegativeTest-1878301721 None] Created reservations ['b45889c3-8d51-4170-8f63-60ca4fe6e2b6', 'd70e2f6c-e9f6-457a-a29f-60164d833aa5', '31057e32-7a20-4fa2-8730-f12b53d5b7b0', '50985140-0e90-4baf-8f78-f9c567f89afd'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:59:56 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-561294dc-fa0c-4048-bd14-da85f4894790 tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.8ed22fda-6c5d-4713-ab45-28a7324fb9e8 1G" returned: 0 in 0.703s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-561294dc-fa0c-4048-bd14-da85f4894790 tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.8ed22fda-6c5d-4713-ab45-28a7324fb9e8 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b9848c6a-3366-46e1-b1c8-7adce717a8d9 tempest-VolumesCloneNegativeTest-1878301721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b9848c6a-3366-46e1-b1c8-7adce717a8d9 tempest-VolumesCloneNegativeTest-1878301721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b9848c6a-3366-46e1-b1c8-7adce717a8d9 tempest-VolumesCloneNegativeTest-1878301721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b9848c6a-3366-46e1-b1c8-7adce717a8d9 tempest-VolumesCloneNegativeTest-1878301721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b9848c6a-3366-46e1-b1c8-7adce717a8d9 tempest-VolumesCloneNegativeTest-1878301721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b9848c6a-3366-46e1-b1c8-7adce717a8d9 tempest-VolumesCloneNegativeTest-1878301721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:56 devstack sudo[100488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.8ed22fda-6c5d-4713-ab45-28a7324fb9e8
Sep 04 15:59:56 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:56 devstack sudo[100491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:59:56 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:56 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-646d15e1-967e-4465-a7a2-050125cbd12a tempest-ProjectReaderTests-1198497729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b381124-2bc1-4d7f-8c30-9d92296e769c" returned: 0 in 0.483s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-646d15e1-967e-4465-a7a2-050125cbd12a tempest-ProjectReaderTests-1198497729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b381124-2bc1-4d7f-8c30-9d92296e769c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:57 devstack sudo[100493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b381124-2bc1-4d7f-8c30-9d92296e769c
Sep 04 15:59:57 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:57 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a" returned: 0 in 0.501s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:57 devstack sudo[100500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a
Sep 04 15:59:57 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:57 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:57 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-561294dc-fa0c-4048-bd14-da85f4894790 tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.8ed22fda-6c5d-4713-ab45-28a7324fb9e8" returned: 0 in 0.453s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b9848c6a-3366-46e1-b1c8-7adce717a8d9 tempest-VolumesCloneNegativeTest-1878301721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.422s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:57 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-561294dc-fa0c-4048-bd14-da85f4894790 tempest-VolumesSnapshotListTestJSON-385803983 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.8ed22fda-6c5d-4713-ab45-28a7324fb9e8 is being set with open permissions: ugo+rw
Sep 04 15:59:57 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-561294dc-fa0c-4048-bd14-da85f4894790 tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.8ed22fda-6c5d-4713-ab45-28a7324fb9e8 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-b9848c6a-3366-46e1-b1c8-7adce717a8d9 tempest-VolumesCloneNegativeTest-1878301721 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:59:57 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-b9848c6a-3366-46e1-b1c8-7adce717a8d9 tempest-VolumesCloneNegativeTest-1878301721 None] Deleted volume successfully.
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-646d15e1-967e-4465-a7a2-050125cbd12a tempest-ProjectReaderTests-1198497729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b381124-2bc1-4d7f-8c30-9d92296e769c" returned: 0 in 0.359s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:57 devstack sudo[100505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.8ed22fda-6c5d-4713-ab45-28a7324fb9e8
Sep 04 15:59:57 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-646d15e1-967e-4465-a7a2-050125cbd12a tempest-ProjectReaderTests-1198497729 None] Lock "cinder-quobyte-9b381124-2bc1-4d7f-8c30-9d92296e769c" released by "delete_volume" :: held 0.912s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b9848c6a-3366-46e1-b1c8-7adce717a8d9 tempest-VolumesCloneNegativeTest-1878301721 None] Lock "cinder-b364fff6-49e7-4011-a026-6534873795f0-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-646d15e1-967e-4465-a7a2-050125cbd12a tempest-ProjectReaderTests-1198497729 None] Created reservations ['4731531e-61ee-4721-859f-ccba53cb3467', '3d770f48-4b6a-44f8-a34d-8ddb977b7cbe', '44ad15cc-1cb1-45ea-b189-d3162eba8235', '1d0006d8-c211-4deb-a004-2185ee838e82'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:59:57 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a" returned: 0 in 0.379s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-quobyte-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a" released by "delete_volume" :: held 0.960s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-646d15e1-967e-4465-a7a2-050125cbd12a tempest-ProjectReaderTests-1198497729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-646d15e1-967e-4465-a7a2-050125cbd12a tempest-ProjectReaderTests-1198497729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-646d15e1-967e-4465-a7a2-050125cbd12a tempest-ProjectReaderTests-1198497729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-646d15e1-967e-4465-a7a2-050125cbd12a tempest-ProjectReaderTests-1198497729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-646d15e1-967e-4465-a7a2-050125cbd12a tempest-ProjectReaderTests-1198497729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-646d15e1-967e-4465-a7a2-050125cbd12a tempest-ProjectReaderTests-1198497729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Created reservations ['52876e2a-8f83-4247-9af3-f86e58a7bd6b', '11268f22-2a53-4c45-b9d4-2aafee232d94', '674c784f-fe49-4ad4-8c4b-8b11e166f78c', '910dfb4d-745b-4ad4-9088-4b27dff3bec9'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 15:59:57 devstack sudo[100508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:59:57 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:57 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-561294dc-fa0c-4048-bd14-da85f4894790 tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.8ed22fda-6c5d-4713-ab45-28a7324fb9e8" returned: 0 in 0.397s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-561294dc-fa0c-4048-bd14-da85f4894790 tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.234s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:57 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-561294dc-fa0c-4048-bd14-da85f4894790 tempest-VolumesSnapshotListTestJSON-385803983 None] Create snapshot completed successfully
Sep 04 15:59:57 devstack sudo[100511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 15:59:57 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:57 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-646d15e1-967e-4465-a7a2-050125cbd12a tempest-ProjectReaderTests-1198497729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.345s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-646d15e1-967e-4465-a7a2-050125cbd12a tempest-ProjectReaderTests-1198497729 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:59:57 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-646d15e1-967e-4465-a7a2-050125cbd12a tempest-ProjectReaderTests-1198497729 None] Deleted volume successfully.
Sep 04 15:59:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-646d15e1-967e-4465-a7a2-050125cbd12a tempest-ProjectReaderTests-1198497729 None] Lock "cinder-9b381124-2bc1-4d7f-8c30-9d92296e769c-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:58 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.340s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:58 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 15:59:58 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Deleted volume successfully.
Sep 04 15:59:58 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-15df3060-5d46-45b0-8964-1eab3b195300 tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-a35f75f1-2411-45c7-a1e2-419bf0ac9f5a-delete_volume" released by "delete_volume" :: held 5.762s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 15:59:58 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:59:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Flow 'volume_create_manager' (f983ad85-7e43-415b-ba33-761c430361e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a7fe16d-26d6-4d5d-8abe-6668c1be69f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a7fe16d-26d6-4d5d-8abe-6668c1be69f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-345515600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf34e310-35ff-459a-a51b-c827b3ed34e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf2b7adb0b9477b8502311f571962fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:59Z,use_quota=True,user_id='b3f0d76282f1485dae98879b6a6624d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb62283-b325-4824-9888-2ea29fcc28ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb62283-b325-4824-9888-2ea29fcc28ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b71a5a9-981e-46d5-bd19-e575731dddb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b71a5a9-981e-46d5-bd19-e575731dddb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf34e310-35ff-459a-a51b-c827b3ed34e5', 'volume_name': 'volume-bf34e310-35ff-459a-a51b-c827b3ed34e5', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c335b89c-eec6-4592-b901-e5c4f4584bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c335b89c-eec6-4592-b901-e5c4f4584bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97225d69-cc17-4734-bd06-f925872e0cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:59 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Volume bf34e310-35ff-459a-a51b-c827b3ed34e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf34e310-35ff-459a-a51b-c827b3ed34e5', 'volume_size': 1}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-345515600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf34e310-35ff-459a-a51b-c827b3ed34e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf2b7adb0b9477b8502311f571962fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:59Z,use_quota=True,user_id='b3f0d76282f1485dae98879b6a6624d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Creating volume bf34e310-35ff-459a-a51b-c827b3ed34e5 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 15:59:59 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:59 devstack sudo[100516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5 1073741824
Sep 04 15:59:59 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Flow 'volume_create_manager' (36456c3d-b277-4d49-ad6c-afedae478b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1821be61-895b-4b7e-ba4d-d2dfac19bf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1821be61-895b-4b7e-ba4d-d2dfac19bf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1920440518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b08347-1388-4e1f-81f6-4f2b81f4695f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeba0df0bcae42f1aef552a70bfa3f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:59Z,use_quota=True,user_id='6baf269a6e88436abae71b49792cb470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (813db06f-a703-4e86-8c30-64c9b1b4af44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (813db06f-a703-4e86-8c30-64c9b1b4af44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d8df804-0968-4983-aef9-536a170693a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d8df804-0968-4983-aef9-536a170693a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19b08347-1388-4e1f-81f6-4f2b81f4695f', 'volume_name': 'volume-19b08347-1388-4e1f-81f6-4f2b81f4695f', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8118280-3eb6-4902-a14c-6fe7ab895efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8118280-3eb6-4902-a14c-6fe7ab895efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4dc956e-4403-4bdc-9276-6c418af2b601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 15:59:59 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Volume 19b08347-1388-4e1f-81f6-4f2b81f4695f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19b08347-1388-4e1f-81f6-4f2b81f4695f', 'volume_size': 1}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dbfcabba-b375-4c47-8a5b-aa1e9ff76eca tempest-VolumesSnapshotListTestJSON-385803983 None] Acquiring lock "cinder-8ed22fda-6c5d-4713-ab45-28a7324fb9e8-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:59 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5 1073741824" returned: 0 in 0.632s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dbfcabba-b375-4c47-8a5b-aa1e9ff76eca tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "cinder-8ed22fda-6c5d-4713-ab45-28a7324fb9e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dbfcabba-b375-4c47-8a5b-aa1e9ff76eca tempest-VolumesSnapshotListTestJSON-385803983 None] Acquiring lock "cinder-quobyte-2d95ac72-a1a8-446e-b406-15157718a04f" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dbfcabba-b375-4c47-8a5b-aa1e9ff76eca tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "cinder-quobyte-2d95ac72-a1a8-446e-b406-15157718a04f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dbfcabba-b375-4c47-8a5b-aa1e9ff76eca tempest-VolumesSnapshotListTestJSON-385803983 None] Acquiring lock "cinder-quobyte-8ed22fda-6c5d-4713-ab45-28a7324fb9e8" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dbfcabba-b375-4c47-8a5b-aa1e9ff76eca tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "cinder-quobyte-8ed22fda-6c5d-4713-ab45-28a7324fb9e8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-dbfcabba-b375-4c47-8a5b-aa1e9ff76eca tempest-VolumesSnapshotListTestJSON-385803983 None] Deleting offline snapshot 8ed22fda-6c5d-4713-ab45-28a7324fb9e8 of volume 2d95ac72-a1a8-446e-b406-15157718a04f {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-dbfcabba-b375-4c47-8a5b-aa1e9ff76eca tempest-VolumesSnapshotListTestJSON-385803983 None] snapshot_file for this snap is: volume-2d95ac72-a1a8-446e-b406-15157718a04f.8ed22fda-6c5d-4713-ab45-28a7324fb9e8 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71ad195-42b6-4a96-800a-516a5f0bfebf]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 15:59:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dbfcabba-b375-4c47-8a5b-aa1e9ff76eca tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.8ed22fda-6c5d-4713-ab45-28a7324fb9e8 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 15:59:59 devstack sudo[100522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5
Sep 04 15:59:59 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 15:59:59 devstack sudo[100523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.8ed22fda-6c5d-4713-ab45-28a7324fb9e8
Sep 04 15:59:59 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:00 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5" returned: 0 in 0.269s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.385s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T13:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1920440518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b08347-1388-4e1f-81f6-4f2b81f4695f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeba0df0bcae42f1aef552a70bfa3f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:59Z,use_quota=True,user_id='6baf269a6e88436abae71b49792cb470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Creating volume 19b08347-1388-4e1f-81f6-4f2b81f4695f {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:00:00 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-19b08347-1388-4e1f-81f6-4f2b81f4695f 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97225d69-cc17-4734-bd06-f925872e0cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf34e310-35ff-459a-a51b-c827b3ed34e5', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:00 devstack sudo[100527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-19b08347-1388-4e1f-81f6-4f2b81f4695f 1073741824
Sep 04 16:00:00 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720bcaa8-e0b6-40dc-b17e-463791d5246a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:00 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Volume volume-bf34e310-35ff-459a-a51b-c827b3ed34e5 (bf34e310-35ff-459a-a51b-c827b3ed34e5): created successfully
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720bcaa8-e0b6-40dc-b17e-463791d5246a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Flow 'volume_create_manager' (f983ad85-7e43-415b-ba33-761c430361e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:00:00 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-631eebac-7b5a-477a-95f8-eb15e1b3c48e tempest-VolumesDeleteCascade-925960500 None] Created volume successfully.
Sep 04 16:00:00 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dbfcabba-b375-4c47-8a5b-aa1e9ff76eca tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.8ed22fda-6c5d-4713-ab45-28a7324fb9e8" returned: 0 in 0.425s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-dbfcabba-b375-4c47-8a5b-aa1e9ff76eca tempest-VolumesSnapshotListTestJSON-385803983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d95ac72-a1a8-446e-b406-15157718a04f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[714d1ea5-9bc9-4579-8802-1b409db4271a]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dbfcabba-b375-4c47-8a5b-aa1e9ff76eca tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:00 devstack sudo[100533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de
Sep 04 16:00:00 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:00 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-19b08347-1388-4e1f-81f6-4f2b81f4695f 1073741824" returned: 0 in 0.559s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-19b08347-1388-4e1f-81f6-4f2b81f4695f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:00 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dbfcabba-b375-4c47-8a5b-aa1e9ff76eca tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de" returned: 0 in 0.441s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-dbfcabba-b375-4c47-8a5b-aa1e9ff76eca tempest-VolumesSnapshotListTestJSON-385803983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d95ac72-a1a8-446e-b406-15157718a04f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dbfcabba-b375-4c47-8a5b-aa1e9ff76eca tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.8ed22fda-6c5d-4713-ab45-28a7324fb9e8 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:00 devstack sudo[100542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-19b08347-1388-4e1f-81f6-4f2b81f4695f
Sep 04 16:00:00 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:00 devstack sudo[100543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.8ed22fda-6c5d-4713-ab45-28a7324fb9e8
Sep 04 16:00:00 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:00 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-19b08347-1388-4e1f-81f6-4f2b81f4695f" returned: 0 in 0.305s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4dc956e-4403-4bdc-9276-6c418af2b601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19b08347-1388-4e1f-81f6-4f2b81f4695f', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (239f175c-307a-41a8-93c5-0d3a97e593b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:00 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Volume volume-19b08347-1388-4e1f-81f6-4f2b81f4695f (19b08347-1388-4e1f-81f6-4f2b81f4695f): created successfully
Sep 04 16:00:01 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (239f175c-307a-41a8-93c5-0d3a97e593b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:01 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Flow 'volume_create_manager' (36456c3d-b277-4d49-ad6c-afedae478b40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:00:01 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-097b7727-73f6-46f6-bc38-6c73ed04fb2a tempest-ProjectReaderTests-1198497729 None] Created volume successfully.
Sep 04 16:00:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a28c958b-e551-4520-9d6b-93a199debd13 tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a28c958b-e551-4520-9d6b-93a199debd13 tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:01 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-a28c958b-e551-4520-9d6b-93a199debd13 tempest-VolumesDeleteCascade-925960500 None] Creating offline snapshot 69991f2d-22c4-4f71-b8fe-1e8316e93e68 of volume bf34e310-35ff-459a-a51b-c827b3ed34e5 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 16:00:01 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ccbc91-5b24-4e0b-904c-67891d3d1360]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:00:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a28c958b-e551-4520-9d6b-93a199debd13 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:01 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dbfcabba-b375-4c47-8a5b-aa1e9ff76eca tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.8ed22fda-6c5d-4713-ab45-28a7324fb9e8" returned: 0 in 0.574s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dbfcabba-b375-4c47-8a5b-aa1e9ff76eca tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.8ed22fda-6c5d-4713-ab45-28a7324fb9e8 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:01 devstack sudo[100551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.8ed22fda-6c5d-4713-ab45-28a7324fb9e8
Sep 04 16:00:01 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:01 devstack sudo[100550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5
Sep 04 16:00:01 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:01 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dbfcabba-b375-4c47-8a5b-aa1e9ff76eca tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.8ed22fda-6c5d-4713-ab45-28a7324fb9e8" returned: 0 in 0.289s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:01 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dbfcabba-b375-4c47-8a5b-aa1e9ff76eca tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "cinder-quobyte-8ed22fda-6c5d-4713-ab45-28a7324fb9e8" released by "_delete_snapshot" :: held 1.839s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:01 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dbfcabba-b375-4c47-8a5b-aa1e9ff76eca tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "cinder-quobyte-2d95ac72-a1a8-446e-b406-15157718a04f" released by "delete_snapshot" :: held 1.871s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:01 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a28c958b-e551-4520-9d6b-93a199debd13 tempest-VolumesDeleteCascade-925960500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5" returned: 0 in 0.443s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a28c958b-e551-4520-9d6b-93a199debd13 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.69991f2d-22c4-4f71-b8fe-1e8316e93e68 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:01 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a706b40b-2218-4a0a-a023-26c174513d8d tempest-ProjectReaderTests-1198497729 None] Acquiring lock "cinder-19b08347-1388-4e1f-81f6-4f2b81f4695f-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:01 devstack sudo[100559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.69991f2d-22c4-4f71-b8fe-1e8316e93e68 1G
Sep 04 16:00:01 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:01 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a706b40b-2218-4a0a-a023-26c174513d8d tempest-ProjectReaderTests-1198497729 None] Lock "cinder-19b08347-1388-4e1f-81f6-4f2b81f4695f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:01 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a706b40b-2218-4a0a-a023-26c174513d8d tempest-ProjectReaderTests-1198497729 None] Acquiring lock "cinder-quobyte-19b08347-1388-4e1f-81f6-4f2b81f4695f" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:01 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a706b40b-2218-4a0a-a023-26c174513d8d tempest-ProjectReaderTests-1198497729 None] Lock "cinder-quobyte-19b08347-1388-4e1f-81f6-4f2b81f4695f" acquired by "delete_volume" :: waited 0.044s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:01 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-dbfcabba-b375-4c47-8a5b-aa1e9ff76eca tempest-VolumesSnapshotListTestJSON-385803983 None] Created reservations ['8040704e-8932-4e5c-8233-1d5690423ea2', '60a65869-db2d-4175-a28c-d2019dd2f03e', '71446596-4473-459b-aaf3-d61cae1757e8', '3773273c-ce3b-4e58-a442-804d1f2b9ab5'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:00:01 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f13e661-c18a-4abf-b363-5ebc07d59c39]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:00:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a706b40b-2218-4a0a-a023-26c174513d8d tempest-ProjectReaderTests-1198497729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-19b08347-1388-4e1f-81f6-4f2b81f4695f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:01 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-dbfcabba-b375-4c47-8a5b-aa1e9ff76eca tempest-VolumesSnapshotListTestJSON-385803983 None] Delete snapshot completed successfully.
Sep 04 16:00:01 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dbfcabba-b375-4c47-8a5b-aa1e9ff76eca tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "cinder-8ed22fda-6c5d-4713-ab45-28a7324fb9e8-delete_snapshot" released by "delete_snapshot" :: held 2.276s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:01 devstack sudo[100561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-19b08347-1388-4e1f-81f6-4f2b81f4695f
Sep 04 16:00:01 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:02 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a28c958b-e551-4520-9d6b-93a199debd13 tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.69991f2d-22c4-4f71-b8fe-1e8316e93e68 1G" returned: 0 in 0.602s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a28c958b-e551-4520-9d6b-93a199debd13 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf34e310-35ff-459a-a51b-c827b3ed34e5 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.69991f2d-22c4-4f71-b8fe-1e8316e93e68 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:02 devstack sudo[100569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf34e310-35ff-459a-a51b-c827b3ed34e5 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.69991f2d-22c4-4f71-b8fe-1e8316e93e68
Sep 04 16:00:02 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:02 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a706b40b-2218-4a0a-a023-26c174513d8d tempest-ProjectReaderTests-1198497729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-19b08347-1388-4e1f-81f6-4f2b81f4695f" returned: 0 in 0.441s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a706b40b-2218-4a0a-a023-26c174513d8d tempest-ProjectReaderTests-1198497729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-19b08347-1388-4e1f-81f6-4f2b81f4695f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:02 devstack sudo[100572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-19b08347-1388-4e1f-81f6-4f2b81f4695f
Sep 04 16:00:02 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:02 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a28c958b-e551-4520-9d6b-93a199debd13 tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf34e310-35ff-459a-a51b-c827b3ed34e5 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.69991f2d-22c4-4f71-b8fe-1e8316e93e68" returned: 0 in 0.368s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:02 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-a28c958b-e551-4520-9d6b-93a199debd13 tempest-VolumesDeleteCascade-925960500 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.69991f2d-22c4-4f71-b8fe-1e8316e93e68 is being set with open permissions: ugo+rw
Sep 04 16:00:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a28c958b-e551-4520-9d6b-93a199debd13 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.69991f2d-22c4-4f71-b8fe-1e8316e93e68 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:02 devstack sudo[100615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.69991f2d-22c4-4f71-b8fe-1e8316e93e68
Sep 04 16:00:02 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:02 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a706b40b-2218-4a0a-a023-26c174513d8d tempest-ProjectReaderTests-1198497729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-19b08347-1388-4e1f-81f6-4f2b81f4695f" returned: 0 in 0.347s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:02 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a706b40b-2218-4a0a-a023-26c174513d8d tempest-ProjectReaderTests-1198497729 None] Lock "cinder-quobyte-19b08347-1388-4e1f-81f6-4f2b81f4695f" released by "delete_volume" :: held 0.848s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:02 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-a706b40b-2218-4a0a-a023-26c174513d8d tempest-ProjectReaderTests-1198497729 None] Created reservations ['bf8eb01d-75d8-49c5-889b-96d848ef680e', '4252efb6-7e93-4d1b-ab5a-9b1cec9685aa', '0a6e8f0a-d874-4aae-b295-5a244133abcb', '69771ec6-0d63-4763-b428-823a0eb89b14'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:00:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a706b40b-2218-4a0a-a023-26c174513d8d tempest-ProjectReaderTests-1198497729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a706b40b-2218-4a0a-a023-26c174513d8d tempest-ProjectReaderTests-1198497729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:02 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a706b40b-2218-4a0a-a023-26c174513d8d tempest-ProjectReaderTests-1198497729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:00:02 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a706b40b-2218-4a0a-a023-26c174513d8d tempest-ProjectReaderTests-1198497729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:00:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a706b40b-2218-4a0a-a023-26c174513d8d tempest-ProjectReaderTests-1198497729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a706b40b-2218-4a0a-a023-26c174513d8d tempest-ProjectReaderTests-1198497729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:02 devstack sudo[100617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:00:02 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:02 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:02 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dd2dd460-533e-47bb-bd06-ac756c074baa tempest-VolumesSnapshotListTestJSON-385803983 None] Acquiring lock "cinder-5f6e2fca-482c-47f2-bece-8b506bbf45de-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a28c958b-e551-4520-9d6b-93a199debd13 tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.69991f2d-22c4-4f71-b8fe-1e8316e93e68" returned: 0 in 0.354s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:02 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dd2dd460-533e-47bb-bd06-ac756c074baa tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "cinder-5f6e2fca-482c-47f2-bece-8b506bbf45de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:02 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dd2dd460-533e-47bb-bd06-ac756c074baa tempest-VolumesSnapshotListTestJSON-385803983 None] Acquiring lock "cinder-quobyte-2d95ac72-a1a8-446e-b406-15157718a04f" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a28c958b-e551-4520-9d6b-93a199debd13 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:03 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dd2dd460-533e-47bb-bd06-ac756c074baa tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "cinder-quobyte-2d95ac72-a1a8-446e-b406-15157718a04f" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:03 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dd2dd460-533e-47bb-bd06-ac756c074baa tempest-VolumesSnapshotListTestJSON-385803983 None] Acquiring lock "cinder-quobyte-5f6e2fca-482c-47f2-bece-8b506bbf45de" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:03 devstack sudo[100622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.info
Sep 04 16:00:03 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:03 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dd2dd460-533e-47bb-bd06-ac756c074baa tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "cinder-quobyte-5f6e2fca-482c-47f2-bece-8b506bbf45de" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:03 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-dd2dd460-533e-47bb-bd06-ac756c074baa tempest-VolumesSnapshotListTestJSON-385803983 None] Deleting offline snapshot 5f6e2fca-482c-47f2-bece-8b506bbf45de of volume 2d95ac72-a1a8-446e-b406-15157718a04f {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 16:00:03 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-dd2dd460-533e-47bb-bd06-ac756c074baa tempest-VolumesSnapshotListTestJSON-385803983 None] snapshot_file for this snap is: volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 16:00:03 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7865c9-a1d8-4c62-9cc2-685498abc4a7]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:00:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dd2dd460-533e-47bb-bd06-ac756c074baa tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:03 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a706b40b-2218-4a0a-a023-26c174513d8d tempest-ProjectReaderTests-1198497729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.350s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:03 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-a706b40b-2218-4a0a-a023-26c174513d8d tempest-ProjectReaderTests-1198497729 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:00:03 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-a706b40b-2218-4a0a-a023-26c174513d8d tempest-ProjectReaderTests-1198497729 None] Deleted volume successfully.
Sep 04 16:00:03 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a706b40b-2218-4a0a-a023-26c174513d8d tempest-ProjectReaderTests-1198497729 None] Lock "cinder-19b08347-1388-4e1f-81f6-4f2b81f4695f-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:03 devstack sudo[100624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de
Sep 04 16:00:03 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:03 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a28c958b-e551-4520-9d6b-93a199debd13 tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.info" returned: 0 in 0.357s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:03 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-a28c958b-e551-4520-9d6b-93a199debd13 tempest-VolumesDeleteCascade-925960500 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.info is being set with open permissions: ugo+rw
Sep 04 16:00:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a28c958b-e551-4520-9d6b-93a199debd13 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:03 devstack sudo[100628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.info
Sep 04 16:00:03 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:03 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dd2dd460-533e-47bb-bd06-ac756c074baa tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de" returned: 0 in 0.489s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:03 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-dd2dd460-533e-47bb-bd06-ac756c074baa tempest-VolumesSnapshotListTestJSON-385803983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d95ac72-a1a8-446e-b406-15157718a04f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:00:03 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2207fd7-32b5-4605-8104-68254a7e6b48]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:00:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dd2dd460-533e-47bb-bd06-ac756c074baa tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:03 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a28c958b-e551-4520-9d6b-93a199debd13 tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.info" returned: 0 in 0.336s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a28c958b-e551-4520-9d6b-93a199debd13 tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.599s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:03 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-a28c958b-e551-4520-9d6b-93a199debd13 tempest-VolumesDeleteCascade-925960500 None] Create snapshot completed successfully
Sep 04 16:00:03 devstack sudo[100634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371
Sep 04 16:00:03 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:04 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dd2dd460-533e-47bb-bd06-ac756c074baa tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371" returned: 0 in 0.440s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:04 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-dd2dd460-533e-47bb-bd06-ac756c074baa tempest-VolumesSnapshotListTestJSON-385803983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d95ac72-a1a8-446e-b406-15157718a04f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:00:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dd2dd460-533e-47bb-bd06-ac756c074baa tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:04 devstack sudo[100640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de
Sep 04 16:00:04 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:04 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dd2dd460-533e-47bb-bd06-ac756c074baa tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de" returned: 0 in 0.536s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dd2dd460-533e-47bb-bd06-ac756c074baa tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:04 devstack sudo[100647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de
Sep 04 16:00:04 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:04 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Flow 'volume_create_manager' (b6b4e8f5-2387-4446-90e6-81b16babb33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f10c88d-9202-4630-971a-89cef0ffae5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:05 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f10c88d-9202-4630-971a-89cef0ffae5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-447478661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6779057d-e35d-4b1c-9b01-e583f73cae84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf2b7adb0b9477b8502311f571962fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=69991f2d-22c4-4f71-b8fe-1e8316e93e68,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:05Z,use_quota=True,user_id='b3f0d76282f1485dae98879b6a6624d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987c285c-e3e5-470b-8ee4-18c5216bf5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987c285c-e3e5-470b-8ee4-18c5216bf5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a860efd-b229-480c-bbf4-ba169f2a751c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a860efd-b229-480c-bbf4-ba169f2a751c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6779057d-e35d-4b1c-9b01-e583f73cae84', 'volume_name': 'volume-6779057d-e35d-4b1c-9b01-e583f73cae84', 'volume_size': 1, 'snapshot_id': '69991f2d-22c4-4f71-b8fe-1e8316e93e68'}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d892307-45d3-421a-9292-9520de79ca2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d892307-45d3-421a-9292-9520de79ca2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be673158-fd4a-427d-a58e-dc862a4a9092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:05 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Volume 6779057d-e35d-4b1c-9b01-e583f73cae84: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6779057d-e35d-4b1c-9b01-e583f73cae84', 'volume_size': 1, 'snapshot_id': '69991f2d-22c4-4f71-b8fe-1e8316e93e68'}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dd2dd460-533e-47bb-bd06-ac756c074baa tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.5f6e2fca-482c-47f2-bece-8b506bbf45de" returned: 0 in 0.513s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "cinder-quobyte-69991f2d-22c4-4f71-b8fe-1e8316e93e68-6779057d-e35d-4b1c-9b01-e583f73cae84" by "_create_volume_from_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dd2dd460-533e-47bb-bd06-ac756c074baa tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "cinder-quobyte-5f6e2fca-482c-47f2-bece-8b506bbf45de" released by "_delete_snapshot" :: held 2.129s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dd2dd460-533e-47bb-bd06-ac756c074baa tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "cinder-quobyte-2d95ac72-a1a8-446e-b406-15157718a04f" released by "delete_snapshot" :: held 2.172s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-quobyte-69991f2d-22c4-4f71-b8fe-1e8316e93e68-6779057d-e35d-4b1c-9b01-e583f73cae84" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Creating volume 6779057d-e35d-4b1c-9b01-e583f73cae84 from snapshot 69991f2d-22c4-4f71-b8fe-1e8316e93e68 {{(pid=87504) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "cinder-quobyte-6779057d-e35d-4b1c-9b01-e583f73cae84" by "_copy_volume_from_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-quobyte-6779057d-e35d-4b1c-9b01-e583f73cae84" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] snapshot: 69991f2d-22c4-4f71-b8fe-1e8316e93e68, volume: 6779057d-e35d-4b1c-9b01-e583f73cae84,  {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[421991d2-f266-4e27-9c39-4bdf8b238b64]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.69991f2d-22c4-4f71-b8fe-1e8316e93e68 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-dd2dd460-533e-47bb-bd06-ac756c074baa tempest-VolumesSnapshotListTestJSON-385803983 None] Created reservations ['e542cfda-6743-47fd-a5ee-c0b1d0acdfa2', '50b86b52-a262-44f6-b89f-0adc8c245a3c', '043333c1-7fa6-4ee6-9276-9948c467e9a7', '2afef98c-6613-4b71-a664-13e2dd7ac771'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:00:05 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-dd2dd460-533e-47bb-bd06-ac756c074baa tempest-VolumesSnapshotListTestJSON-385803983 None] Delete snapshot completed successfully.
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dd2dd460-533e-47bb-bd06-ac756c074baa tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "cinder-5f6e2fca-482c-47f2-bece-8b506bbf45de-delete_snapshot" released by "delete_snapshot" :: held 2.465s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:05 devstack sudo[100650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.69991f2d-22c4-4f71-b8fe-1e8316e93e68
Sep 04 16:00:05 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:05 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.69991f2d-22c4-4f71-b8fe-1e8316e93e68" returned: 0 in 0.444s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf34e310-35ff-459a-a51b-c827b3ed34e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad4f56d-f4ce-4d03-a53e-3c57ad3ebf40]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:00:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:05 devstack sudo[100655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5
Sep 04 16:00:05 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:06 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b7193622-2474-4d91-9e0a-973df358a6ed tempest-VolumesSnapshotListTestJSON-385803983 None] Acquiring lock "cinder-2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5" returned: 0 in 0.513s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5 {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 04 16:00:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Creating direct copy from snapshot {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 04 16:00:06 devstack cinder-volume[87504]: DEBUG cinder.utils [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Path /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6779057d-e35d-4b1c-9b01-e583f73cae84 not found in is_blk_device check {{(pid=87504) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 04 16:00:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6779057d-e35d-4b1c-9b01-e583f73cae84 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b7193622-2474-4d91-9e0a-973df358a6ed tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "cinder-2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371-delete_snapshot" acquired by "delete_snapshot" :: waited 0.082s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b7193622-2474-4d91-9e0a-973df358a6ed tempest-VolumesSnapshotListTestJSON-385803983 None] Acquiring lock "cinder-quobyte-2d95ac72-a1a8-446e-b406-15157718a04f" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:06 devstack sudo[100661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6779057d-e35d-4b1c-9b01-e583f73cae84
Sep 04 16:00:06 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b7193622-2474-4d91-9e0a-973df358a6ed tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "cinder-quobyte-2d95ac72-a1a8-446e-b406-15157718a04f" acquired by "delete_snapshot" :: waited 0.076s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b7193622-2474-4d91-9e0a-973df358a6ed tempest-VolumesSnapshotListTestJSON-385803983 None] Acquiring lock "cinder-quobyte-2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b7193622-2474-4d91-9e0a-973df358a6ed tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "cinder-quobyte-2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-b7193622-2474-4d91-9e0a-973df358a6ed tempest-VolumesSnapshotListTestJSON-385803983 None] Deleting offline snapshot 2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371 of volume 2d95ac72-a1a8-446e-b406-15157718a04f {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 16:00:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-b7193622-2474-4d91-9e0a-973df358a6ed tempest-VolumesSnapshotListTestJSON-385803983 None] snapshot_file for this snap is: volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 16:00:06 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f8d5a8-5d02-42a8-b954-cbb54ab6d255]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:00:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b7193622-2474-4d91-9e0a-973df358a6ed tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:06 devstack sudo[100663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371
Sep 04 16:00:06 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:06 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b7193622-2474-4d91-9e0a-973df358a6ed tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371" returned: 0 in 0.453s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-b7193622-2474-4d91-9e0a-973df358a6ed tempest-VolumesSnapshotListTestJSON-385803983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d95ac72-a1a8-446e-b406-15157718a04f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:00:07 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b731d6-66fe-4726-95d0-51cf173c55c9]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:00:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b7193622-2474-4d91-9e0a-973df358a6ed tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:07 devstack sudo[100680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f
Sep 04 16:00:07 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:08 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b7193622-2474-4d91-9e0a-973df358a6ed tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f" returned: 0 in 1.105s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b7193622-2474-4d91-9e0a-973df358a6ed tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:08 devstack sudo[100685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371
Sep 04 16:00:08 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:09 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b7193622-2474-4d91-9e0a-973df358a6ed tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371" returned: 0 in 1.236s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b7193622-2474-4d91-9e0a-973df358a6ed tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:09 devstack sudo[100690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371
Sep 04 16:00:09 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:10 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b7193622-2474-4d91-9e0a-973df358a6ed tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f.2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371" returned: 0 in 0.738s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:10 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b7193622-2474-4d91-9e0a-973df358a6ed tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "cinder-quobyte-2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371" released by "_delete_snapshot" :: held 3.818s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:10 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b7193622-2474-4d91-9e0a-973df358a6ed tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "cinder-quobyte-2d95ac72-a1a8-446e-b406-15157718a04f" released by "delete_snapshot" :: held 3.911s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:10 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-b7193622-2474-4d91-9e0a-973df358a6ed tempest-VolumesSnapshotListTestJSON-385803983 None] Created reservations ['1e7d58e8-a26d-44b5-ae75-fff64a3a54a4', '7cff2168-11d3-4998-b445-efe92c500660', '6077741d-9fe2-4336-b731-084fd4867830', 'bb6d5d4f-1d1b-43d8-bf23-08d46de57955'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:00:10 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-b7193622-2474-4d91-9e0a-973df358a6ed tempest-VolumesSnapshotListTestJSON-385803983 None] Delete snapshot completed successfully.
Sep 04 16:00:10 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b7193622-2474-4d91-9e0a-973df358a6ed tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "cinder-2962a9d9-c0ae-4dbb-b5d8-2fabd7a82371-delete_snapshot" released by "delete_snapshot" :: held 4.494s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:11 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-924b360b-e4f5-469c-a6c1-a1c83f89acdf tempest-VolumesSnapshotListTestJSON-385803983 None] Acquiring lock "cinder-2d95ac72-a1a8-446e-b406-15157718a04f-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:11 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-924b360b-e4f5-469c-a6c1-a1c83f89acdf tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "cinder-2d95ac72-a1a8-446e-b406-15157718a04f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:11 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-924b360b-e4f5-469c-a6c1-a1c83f89acdf tempest-VolumesSnapshotListTestJSON-385803983 None] Acquiring lock "cinder-quobyte-2d95ac72-a1a8-446e-b406-15157718a04f" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:11 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-924b360b-e4f5-469c-a6c1-a1c83f89acdf tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "cinder-quobyte-2d95ac72-a1a8-446e-b406-15157718a04f" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:11 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7032f2da-3bf4-4f38-90f6-62076e5852d3]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:00:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-924b360b-e4f5-469c-a6c1-a1c83f89acdf tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:11 devstack sudo[100693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f
Sep 04 16:00:11 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:12 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6779057d-e35d-4b1c-9b01-e583f73cae84" returned: 0 in 5.905s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:12 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5, size 1024.00 MB, duration 5.91 sec, destination /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6779057d-e35d-4b1c-9b01-e583f73cae84 {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 16:00:12 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Converted 1024.00 MB image at 173.36 MB/s
Sep 04 16:00:12 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6779057d-e35d-4b1c-9b01-e583f73cae84 is being set with open permissions: ugo+rw
Sep 04 16:00:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6779057d-e35d-4b1c-9b01-e583f73cae84 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:12 devstack sudo[100695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6779057d-e35d-4b1c-9b01-e583f73cae84
Sep 04 16:00:12 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:12 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-924b360b-e4f5-469c-a6c1-a1c83f89acdf tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f" returned: 0 in 1.047s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-924b360b-e4f5-469c-a6c1-a1c83f89acdf tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:12 devstack sudo[100700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f
Sep 04 16:00:12 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:12 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6779057d-e35d-4b1c-9b01-e583f73cae84" returned: 0 in 0.332s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:12 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-quobyte-6779057d-e35d-4b1c-9b01-e583f73cae84" released by "_copy_volume_from_snapshot" :: held 7.324s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:12 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-quobyte-69991f2d-22c4-4f71-b8fe-1e8316e93e68-6779057d-e35d-4b1c-9b01-e583f73cae84" released by "_create_volume_from_snapshot" :: held 7.415s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.454s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be673158-fd4a-427d-a58e-dc862a4a9092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6779057d-e35d-4b1c-9b01-e583f73cae84', 'volume_size': 1, 'snapshot_id': '69991f2d-22c4-4f71-b8fe-1e8316e93e68'}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08bd3140-79ef-43e8-91a1-d31515cb8975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:12 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:12 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Volume volume-6779057d-e35d-4b1c-9b01-e583f73cae84 (6779057d-e35d-4b1c-9b01-e583f73cae84): created successfully
Sep 04 16:00:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08bd3140-79ef-43e8-91a1-d31515cb8975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Flow 'volume_create_manager' (b6b4e8f5-2387-4446-90e6-81b16babb33b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:00:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-924b360b-e4f5-469c-a6c1-a1c83f89acdf tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2d95ac72-a1a8-446e-b406-15157718a04f" returned: 0 in 0.301s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:12 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-924b360b-e4f5-469c-a6c1-a1c83f89acdf tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "cinder-quobyte-2d95ac72-a1a8-446e-b406-15157718a04f" released by "delete_volume" :: held 1.497s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:12 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-0554fa28-8cd0-4895-b75b-95fd60517278 tempest-VolumesDeleteCascade-925960500 None] Created volume successfully.
Sep 04 16:00:12 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-924b360b-e4f5-469c-a6c1-a1c83f89acdf tempest-VolumesSnapshotListTestJSON-385803983 None] Created reservations ['f14ed8c7-171c-4220-9c42-1a2edf6c9413', '7bd1a082-957d-45e4-bd67-329247874e75', '508ec5bb-a861-42d9-9cc2-0821adfbad43', '78c138fd-bb1f-4da9-9220-7dbb99057f44'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:00:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-924b360b-e4f5-469c-a6c1-a1c83f89acdf tempest-VolumesSnapshotListTestJSON-385803983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-924b360b-e4f5-469c-a6c1-a1c83f89acdf tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-924b360b-e4f5-469c-a6c1-a1c83f89acdf tempest-VolumesSnapshotListTestJSON-385803983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:00:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-924b360b-e4f5-469c-a6c1-a1c83f89acdf tempest-VolumesSnapshotListTestJSON-385803983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:00:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-924b360b-e4f5-469c-a6c1-a1c83f89acdf tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-924b360b-e4f5-469c-a6c1-a1c83f89acdf tempest-VolumesSnapshotListTestJSON-385803983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:12 devstack sudo[100704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:00:12 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:13 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-924b360b-e4f5-469c-a6c1-a1c83f89acdf tempest-VolumesSnapshotListTestJSON-385803983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.291s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:13 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-924b360b-e4f5-469c-a6c1-a1c83f89acdf tempest-VolumesSnapshotListTestJSON-385803983 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:00:13 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-924b360b-e4f5-469c-a6c1-a1c83f89acdf tempest-VolumesSnapshotListTestJSON-385803983 None] Deleted volume successfully.
Sep 04 16:00:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-924b360b-e4f5-469c-a6c1-a1c83f89acdf tempest-VolumesSnapshotListTestJSON-385803983 None] Lock "cinder-2d95ac72-a1a8-446e-b406-15157718a04f-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "cinder-bf34e310-35ff-459a-a51b-c827b3ed34e5-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-bf34e310-35ff-459a-a51b-c827b3ed34e5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Performing cascade delete. {{(pid=87504) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 04 16:00:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "cinder-69991f2d-22c4-4f71-b8fe-1e8316e93e68-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-69991f2d-22c4-4f71-b8fe-1e8316e93e68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "cinder-quobyte-bf34e310-35ff-459a-a51b-c827b3ed34e5" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-quobyte-bf34e310-35ff-459a-a51b-c827b3ed34e5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "cinder-quobyte-69991f2d-22c4-4f71-b8fe-1e8316e93e68" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-quobyte-69991f2d-22c4-4f71-b8fe-1e8316e93e68" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Deleting offline snapshot 69991f2d-22c4-4f71-b8fe-1e8316e93e68 of volume bf34e310-35ff-459a-a51b-c827b3ed34e5 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 16:00:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] snapshot_file for this snap is: volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.69991f2d-22c4-4f71-b8fe-1e8316e93e68 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 16:00:13 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb96b147-031c-4350-b12c-9f5b40e98294]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:00:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.69991f2d-22c4-4f71-b8fe-1e8316e93e68 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:13 devstack sudo[100707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.69991f2d-22c4-4f71-b8fe-1e8316e93e68
Sep 04 16:00:13 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:13 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.69991f2d-22c4-4f71-b8fe-1e8316e93e68" returned: 0 in 0.399s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf34e310-35ff-459a-a51b-c827b3ed34e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:00:13 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d9a79b-b69d-4a9a-a9ee-a3cb80838971]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:00:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:14 devstack sudo[100712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5
Sep 04 16:00:14 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:14 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5" returned: 0 in 0.701s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.69991f2d-22c4-4f71-b8fe-1e8316e93e68 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:14 devstack sudo[100719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.69991f2d-22c4-4f71-b8fe-1e8316e93e68
Sep 04 16:00:14 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:15 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.69991f2d-22c4-4f71-b8fe-1e8316e93e68" returned: 0 in 0.501s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.69991f2d-22c4-4f71-b8fe-1e8316e93e68 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:15 devstack sudo[100725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.69991f2d-22c4-4f71-b8fe-1e8316e93e68
Sep 04 16:00:15 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:15 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5.69991f2d-22c4-4f71-b8fe-1e8316e93e68" returned: 0 in 0.355s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-quobyte-69991f2d-22c4-4f71-b8fe-1e8316e93e68" released by "_delete_snapshot" :: held 2.106s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-quobyte-bf34e310-35ff-459a-a51b-c827b3ed34e5" released by "delete_snapshot" :: held 2.136s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:15 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Created reservations ['d5c7f683-e46e-47f3-856a-73d650fe4b00', 'e311f93b-cf1e-4a35-9140-aeaeebaf3ad4', '257225f3-3635-4a31-8b47-45d5767f488f', '3a73d16c-3967-4d84-9853-bb62453f9807'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:00:15 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Delete snapshot completed successfully.
Sep 04 16:00:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-69991f2d-22c4-4f71-b8fe-1e8316e93e68-delete_snapshot" released by "delete_snapshot" :: held 2.339s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:15 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Snapshots deleted, issuing volume delete {{(pid=87504) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 04 16:00:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "cinder-quobyte-bf34e310-35ff-459a-a51b-c827b3ed34e5" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-quobyte-bf34e310-35ff-459a-a51b-c827b3ed34e5" acquired by "delete_volume" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:15 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20d82ba-ceff-4d8b-911f-c40232c83879]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:00:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:15 devstack sudo[100728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5
Sep 04 16:00:15 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:16 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5" returned: 0 in 0.421s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:16 devstack sudo[100733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5
Sep 04 16:00:16 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:16 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bf34e310-35ff-459a-a51b-c827b3ed34e5" returned: 0 in 0.331s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-quobyte-bf34e310-35ff-459a-a51b-c827b3ed34e5" released by "delete_volume" :: held 0.852s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:16 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Created reservations ['aa3bb669-c1b3-4685-9b6c-c29c70bd5bfe', 'bfa5aa69-78f1-4344-aefa-9ff2a4b0fc50', '6f6f93a6-b3f5-46ff-b8ae-ca3262cea6b6', '48823885-421c-4ac2-ad13-f20836ae0275'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:00:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:00:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:00:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:16 devstack sudo[100736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:00:16 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:17 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.278s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:00:17 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Deleted volume successfully.
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-6468a818-de69-47e0-ab19-fa3128191a7c tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-bf34e310-35ff-459a-a51b-c827b3ed34e5-delete_volume" released by "delete_volume" :: held 3.801s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Flow 'volume_create_manager' (6b38ab64-87de-4b46-89ee-46648df2d765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9144e1e2-7e0c-4f58-888d-020e1cac75d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9144e1e2-7e0c-4f58-888d-020e1cac75d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1434455553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac52bb502c1434c8c38bd2c04ba22de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:18Z,use_quota=True,user_id='5be270d746284c1b9c6542cea605eebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b73b7fe-cc56-4a39-9a40-80cb2e1f3e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b73b7fe-cc56-4a39-9a40-80cb2e1f3e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5236155c-30ae-4c59-80e3-ffb3d90d1101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5236155c-30ae-4c59-80e3-ffb3d90d1101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b', 'volume_name': 'volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b', 'volume_size': 2}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902a54a8-7c61-42bc-878e-e16f1af4651b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902a54a8-7c61-42bc-878e-e16f1af4651b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9fd1df-e192-4b16-a0ad-9293042bf749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:17 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Volume fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b', 'volume_size': 2}
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1434455553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac52bb502c1434c8c38bd2c04ba22de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:18Z,use_quota=True,user_id='5be270d746284c1b9c6542cea605eebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Creating volume fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:00:17 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b 2147483648 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:17 devstack sudo[100739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b 2147483648
Sep 04 16:00:17 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-af981385-8603-418e-b522-ce93edfc72b6 tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "cinder-6779057d-e35d-4b1c-9b01-e583f73cae84-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-af981385-8603-418e-b522-ce93edfc72b6 tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-6779057d-e35d-4b1c-9b01-e583f73cae84-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-af981385-8603-418e-b522-ce93edfc72b6 tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "cinder-quobyte-6779057d-e35d-4b1c-9b01-e583f73cae84" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-af981385-8603-418e-b522-ce93edfc72b6 tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-quobyte-6779057d-e35d-4b1c-9b01-e583f73cae84" acquired by "delete_volume" :: waited 0.016s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:18 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[78303202-4cc4-4b11-9bbd-c957fb92c6fd]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:00:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-af981385-8603-418e-b522-ce93edfc72b6 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6779057d-e35d-4b1c-9b01-e583f73cae84 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:18 devstack sudo[100741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6779057d-e35d-4b1c-9b01-e583f73cae84
Sep 04 16:00:18 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:18 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b 2147483648" returned: 0 in 0.572s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:18 devstack sudo[100749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b
Sep 04 16:00:18 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:18 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-af981385-8603-418e-b522-ce93edfc72b6 tempest-VolumesDeleteCascade-925960500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6779057d-e35d-4b1c-9b01-e583f73cae84" returned: 0 in 0.432s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-af981385-8603-418e-b522-ce93edfc72b6 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6779057d-e35d-4b1c-9b01-e583f73cae84 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:18 devstack sudo[100751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6779057d-e35d-4b1c-9b01-e583f73cae84
Sep 04 16:00:18 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:18 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b" returned: 0 in 0.283s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:18 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:00:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9fd1df-e192-4b16-a0ad-9293042bf749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b', 'volume_size': 2}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad4b2d2b-1822-42e0-be2c-9ef88f5f8623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:18 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Volume volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b (fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b): created successfully
Sep 04 16:00:18 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad4b2d2b-1822-42e0-be2c-9ef88f5f8623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Flow 'volume_create_manager' (6b38ab64-87de-4b46-89ee-46648df2d765) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:00:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-af981385-8603-418e-b522-ce93edfc72b6 tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6779057d-e35d-4b1c-9b01-e583f73cae84" returned: 0 in 0.298s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:18 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-af981385-8603-418e-b522-ce93edfc72b6 tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-quobyte-6779057d-e35d-4b1c-9b01-e583f73cae84" released by "delete_volume" :: held 0.782s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:18 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-c80be0b5-a30d-4e8b-aa3c-b04c9eae1fb9 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Created volume successfully.
Sep 04 16:00:18 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-af981385-8603-418e-b522-ce93edfc72b6 tempest-VolumesDeleteCascade-925960500 None] Created reservations ['e5653f28-d75f-4b6a-bf39-baf8390eb3f2', '49d2cc1d-f72f-4144-a61d-b5a31e3604a7', '8413f8ab-afc1-4c8e-9b7b-6d97e74190c4', '3bacf217-362a-4cd6-9fdd-e3ab06a776a0'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:00:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-af981385-8603-418e-b522-ce93edfc72b6 tempest-VolumesDeleteCascade-925960500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-af981385-8603-418e-b522-ce93edfc72b6 tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:18 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-af981385-8603-418e-b522-ce93edfc72b6 tempest-VolumesDeleteCascade-925960500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:00:18 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-af981385-8603-418e-b522-ce93edfc72b6 tempest-VolumesDeleteCascade-925960500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:00:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-af981385-8603-418e-b522-ce93edfc72b6 tempest-VolumesDeleteCascade-925960500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-af981385-8603-418e-b522-ce93edfc72b6 tempest-VolumesDeleteCascade-925960500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:18 devstack sudo[100755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:00:18 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:19 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-af981385-8603-418e-b522-ce93edfc72b6 tempest-VolumesDeleteCascade-925960500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.247s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:19 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-af981385-8603-418e-b522-ce93edfc72b6 tempest-VolumesDeleteCascade-925960500 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:00:19 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-af981385-8603-418e-b522-ce93edfc72b6 tempest-VolumesDeleteCascade-925960500 None] Deleted volume successfully.
Sep 04 16:00:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-af981385-8603-418e-b522-ce93edfc72b6 tempest-VolumesDeleteCascade-925960500 None] Lock "cinder-6779057d-e35d-4b1c-9b01-e583f73cae84-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-737df388-6f30-46db-9220-bf87012883fd tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-737df388-6f30-46db-9220-bf87012883fd tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-737df388-6f30-46db-9220-bf87012883fd tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Creating offline snapshot 2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5 of volume fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 16:00:20 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de6089d-b4af-40b2-a86e-44ee0f90e16b]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:00:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-737df388-6f30-46db-9220-bf87012883fd tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:20 devstack sudo[100765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b
Sep 04 16:00:20 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:20 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-737df388-6f30-46db-9220-bf87012883fd tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b" returned: 0 in 0.390s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-737df388-6f30-46db-9220-bf87012883fd tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5 2G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:20 devstack sudo[100770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5 2G
Sep 04 16:00:20 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:20 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-737df388-6f30-46db-9220-bf87012883fd tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5 2G" returned: 0 in 0.500s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-737df388-6f30-46db-9220-bf87012883fd tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:21 devstack sudo[100776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5
Sep 04 16:00:21 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:21 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-737df388-6f30-46db-9220-bf87012883fd tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5" returned: 0 in 0.510s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:21 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-737df388-6f30-46db-9220-bf87012883fd tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5 is being set with open permissions: ugo+rw
Sep 04 16:00:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-737df388-6f30-46db-9220-bf87012883fd tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:21 devstack sudo[100781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5
Sep 04 16:00:21 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:21 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-737df388-6f30-46db-9220-bf87012883fd tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5" returned: 0 in 0.302s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-737df388-6f30-46db-9220-bf87012883fd tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:21 devstack sudo[100786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.info
Sep 04 16:00:21 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:22 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-737df388-6f30-46db-9220-bf87012883fd tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.info" returned: 0 in 0.279s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:22 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-737df388-6f30-46db-9220-bf87012883fd tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.info is being set with open permissions: ugo+rw
Sep 04 16:00:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-737df388-6f30-46db-9220-bf87012883fd tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:22 devstack sudo[100789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.info
Sep 04 16:00:22 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:22 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-737df388-6f30-46db-9220-bf87012883fd tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.info" returned: 0 in 0.295s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-737df388-6f30-46db-9220-bf87012883fd tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.379s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:22 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-737df388-6f30-46db-9220-bf87012883fd tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Create snapshot completed successfully
Sep 04 16:00:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d497c035-469c-4e26-97f7-9246a5bd2582 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Acquiring lock "cinder-2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d497c035-469c-4e26-97f7-9246a5bd2582 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Lock "cinder-2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d497c035-469c-4e26-97f7-9246a5bd2582 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Acquiring lock "cinder-quobyte-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d497c035-469c-4e26-97f7-9246a5bd2582 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Lock "cinder-quobyte-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d497c035-469c-4e26-97f7-9246a5bd2582 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Acquiring lock "cinder-quobyte-2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d497c035-469c-4e26-97f7-9246a5bd2582 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Lock "cinder-quobyte-2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-d497c035-469c-4e26-97f7-9246a5bd2582 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Deleting offline snapshot 2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5 of volume fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 16:00:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-d497c035-469c-4e26-97f7-9246a5bd2582 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] snapshot_file for this snap is: volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 16:00:23 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[195818c1-b9cb-45d2-abe3-b3f9a54c59a1]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:00:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d497c035-469c-4e26-97f7-9246a5bd2582 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:23 devstack sudo[100792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5
Sep 04 16:00:23 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:23 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d497c035-469c-4e26-97f7-9246a5bd2582 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5" returned: 0 in 0.423s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-d497c035-469c-4e26-97f7-9246a5bd2582 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:00:23 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[55febdb7-e944-40cf-9e7c-7d244ae5fe2e]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:00:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d497c035-469c-4e26-97f7-9246a5bd2582 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:24 devstack sudo[100797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b
Sep 04 16:00:24 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Flow 'volume_create_manager' (0b1e4e01-75cd-4490-a6b2-29c24d39ba4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3901e633-b0de-4c95-ac42-ffd055b24aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3901e633-b0de-4c95-ac42-ffd055b24aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-756644592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d422d223-6c10-4470-8a22-25b76fa29eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='032b7192c80b4d5891c32dd4ba95e129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:24Z,use_quota=True,user_id='ed3c7f8c1af84ca19ec4d80fb42d234c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1094c1be-e9d4-43ae-9673-5aa81534e590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1094c1be-e9d4-43ae-9673-5aa81534e590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fbb04c4-f90e-4f57-9ac6-fd09798efb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fbb04c4-f90e-4f57-9ac6-fd09798efb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd422d223-6c10-4470-8a22-25b76fa29eb1', 'volume_name': 'volume-d422d223-6c10-4470-8a22-25b76fa29eb1', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4eaa857-ac64-49c3-8920-69d318e2e842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4eaa857-ac64-49c3-8920-69d318e2e842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27ee224-8223-4266-8bbd-a14c6919e3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:24 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Volume d422d223-6c10-4470-8a22-25b76fa29eb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d422d223-6c10-4470-8a22-25b76fa29eb1', 'volume_size': 1}
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-756644592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d422d223-6c10-4470-8a22-25b76fa29eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='032b7192c80b4d5891c32dd4ba95e129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:24Z,use_quota=True,user_id='ed3c7f8c1af84ca19ec4d80fb42d234c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Creating volume d422d223-6c10-4470-8a22-25b76fa29eb1 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:00:24 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d422d223-6c10-4470-8a22-25b76fa29eb1 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:24 devstack sudo[100804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d422d223-6c10-4470-8a22-25b76fa29eb1 1073741824
Sep 04 16:00:24 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:24 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d497c035-469c-4e26-97f7-9246a5bd2582 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b" returned: 0 in 0.488s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d497c035-469c-4e26-97f7-9246a5bd2582 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:24 devstack sudo[100806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5
Sep 04 16:00:24 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:24 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d497c035-469c-4e26-97f7-9246a5bd2582 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5" returned: 0 in 0.447s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d497c035-469c-4e26-97f7-9246a5bd2582 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:24 devstack sudo[100816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5
Sep 04 16:00:24 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:24 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d422d223-6c10-4470-8a22-25b76fa29eb1 1073741824" returned: 0 in 0.597s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d422d223-6c10-4470-8a22-25b76fa29eb1 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:24 devstack sudo[100818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d422d223-6c10-4470-8a22-25b76fa29eb1
Sep 04 16:00:24 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:25 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d497c035-469c-4e26-97f7-9246a5bd2582 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b.2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5" returned: 0 in 0.282s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d497c035-469c-4e26-97f7-9246a5bd2582 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Lock "cinder-quobyte-2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5" released by "_delete_snapshot" :: held 1.793s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d497c035-469c-4e26-97f7-9246a5bd2582 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Lock "cinder-quobyte-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b" released by "delete_snapshot" :: held 1.820s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:25 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d422d223-6c10-4470-8a22-25b76fa29eb1" returned: 0 in 0.282s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:25 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:00:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27ee224-8223-4266-8bbd-a14c6919e3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d422d223-6c10-4470-8a22-25b76fa29eb1', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f869fb-de0e-4f58-8ef3-c43147a84654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:25 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-d497c035-469c-4e26-97f7-9246a5bd2582 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Created reservations ['d137d9db-9e22-4d6d-b432-360bc170d03d', '0eea0442-78da-42c0-b8dc-4e13a0d3d1ad', '007ed754-d5ff-49e6-91a7-086bd20d7ffb', 'c4dd19b6-49b6-4cb6-9443-d698fd2fff77'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:00:25 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Volume volume-d422d223-6c10-4470-8a22-25b76fa29eb1 (d422d223-6c10-4470-8a22-25b76fa29eb1): created successfully
Sep 04 16:00:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f869fb-de0e-4f58-8ef3-c43147a84654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Flow 'volume_create_manager' (0b1e4e01-75cd-4490-a6b2-29c24d39ba4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:00:25 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-dfa211aa-8c65-445b-84fe-b2272b812ad7 tempest-VolumesTransfersTest-1427503463 None] Created volume successfully.
Sep 04 16:00:25 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-d497c035-469c-4e26-97f7-9246a5bd2582 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Delete snapshot completed successfully.
Sep 04 16:00:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d497c035-469c-4e26-97f7-9246a5bd2582 tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Lock "cinder-2e1f5167-cde8-4bf5-9af6-3bf1d6742fd5-delete_snapshot" released by "delete_snapshot" :: held 2.105s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a1792dbb-ad14-46ee-9adb-3dd71f146dae tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Acquiring lock "cinder-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a1792dbb-ad14-46ee-9adb-3dd71f146dae tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Lock "cinder-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a1792dbb-ad14-46ee-9adb-3dd71f146dae tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Acquiring lock "cinder-quobyte-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a1792dbb-ad14-46ee-9adb-3dd71f146dae tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Lock "cinder-quobyte-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b" acquired by "delete_volume" :: waited 0.021s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:25 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[61886981-a6b6-4cc2-ace1-12b7abe051c0]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:00:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a1792dbb-ad14-46ee-9adb-3dd71f146dae tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:25 devstack sudo[100822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b
Sep 04 16:00:25 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:26 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a1792dbb-ad14-46ee-9adb-3dd71f146dae tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b" returned: 0 in 0.383s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a1792dbb-ad14-46ee-9adb-3dd71f146dae tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:26 devstack sudo[100827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b
Sep 04 16:00:26 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:26 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a1792dbb-ad14-46ee-9adb-3dd71f146dae tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b" returned: 0 in 0.369s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:26 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a1792dbb-ad14-46ee-9adb-3dd71f146dae tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Lock "cinder-quobyte-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b" released by "delete_volume" :: held 0.832s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:26 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-a1792dbb-ad14-46ee-9adb-3dd71f146dae tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Created reservations ['4a69861c-a3ac-4b24-9369-943a9fc6fb86', '68dc4cab-4656-46d2-9555-90f1b118a778', '1a0506c0-ad43-4728-89de-a9aba602a41d', '10d8a786-0e37-4579-8f04-567f5fa544ea'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:00:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a1792dbb-ad14-46ee-9adb-3dd71f146dae tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a1792dbb-ad14-46ee-9adb-3dd71f146dae tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a1792dbb-ad14-46ee-9adb-3dd71f146dae tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:00:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a1792dbb-ad14-46ee-9adb-3dd71f146dae tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:00:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a1792dbb-ad14-46ee-9adb-3dd71f146dae tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a1792dbb-ad14-46ee-9adb-3dd71f146dae tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:26 devstack sudo[100830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:00:26 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:27 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-7b7fb98b-e40c-4374-9b1c-43ce11902bcd tempest-VolumesTransfersTest-137239546 None] Transfer volume completed successfully.
Sep 04 16:00:27 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a1792dbb-ad14-46ee-9adb-3dd71f146dae tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.478s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:27 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-a1792dbb-ad14-46ee-9adb-3dd71f146dae tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:00:27 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-a1792dbb-ad14-46ee-9adb-3dd71f146dae tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Deleted volume successfully.
Sep 04 16:00:27 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a1792dbb-ad14-46ee-9adb-3dd71f146dae tempest-VolumesSnapshotNegativeTestJSON-1585025556 None] Lock "cinder-fb6d6d2c-76ab-4402-9ab4-b7d13fcb554b-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d69c53fc-6f64-422d-8b77-616c313afbc2 tempest-VolumesTransfersTest-777100485 None] Acquiring lock "cinder-d422d223-6c10-4470-8a22-25b76fa29eb1-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d69c53fc-6f64-422d-8b77-616c313afbc2 tempest-VolumesTransfersTest-777100485 None] Lock "cinder-d422d223-6c10-4470-8a22-25b76fa29eb1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d69c53fc-6f64-422d-8b77-616c313afbc2 tempest-VolumesTransfersTest-777100485 None] Acquiring lock "cinder-quobyte-d422d223-6c10-4470-8a22-25b76fa29eb1" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d69c53fc-6f64-422d-8b77-616c313afbc2 tempest-VolumesTransfersTest-777100485 None] Lock "cinder-quobyte-d422d223-6c10-4470-8a22-25b76fa29eb1" acquired by "delete_volume" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e59105-ac40-4859-b798-39c54d9504b4]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d69c53fc-6f64-422d-8b77-616c313afbc2 tempest-VolumesTransfersTest-777100485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d422d223-6c10-4470-8a22-25b76fa29eb1 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:28 devstack sudo[100833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d422d223-6c10-4470-8a22-25b76fa29eb1
Sep 04 16:00:28 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:28 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d69c53fc-6f64-422d-8b77-616c313afbc2 tempest-VolumesTransfersTest-777100485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d422d223-6c10-4470-8a22-25b76fa29eb1" returned: 0 in 0.478s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d69c53fc-6f64-422d-8b77-616c313afbc2 tempest-VolumesTransfersTest-777100485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d422d223-6c10-4470-8a22-25b76fa29eb1 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:28 devstack sudo[100838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d422d223-6c10-4470-8a22-25b76fa29eb1
Sep 04 16:00:28 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Flow 'volume_create_manager' (9e9be5da-e4bb-4900-83ec-f0b71927296f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea3ee55-89b5-43cf-b8c0-8ca36841d72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea3ee55-89b5-43cf-b8c0-8ca36841d72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1593816544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676f322d-1252-4646-967f-f22edc9a15c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5511f4f88ff4dc588116f1b1ab3b141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:29Z,use_quota=True,user_id='d248f929223f46178c97134fbf734c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd12eeb-eecb-4104-b944-6a0ca92a8dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd12eeb-eecb-4104-b944-6a0ca92a8dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a56dfaf-7026-4d78-9129-7a5e65cf0b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a56dfaf-7026-4d78-9129-7a5e65cf0b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '676f322d-1252-4646-967f-f22edc9a15c3', 'volume_name': 'volume-676f322d-1252-4646-967f-f22edc9a15c3', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e21166-9373-4684-a204-61d4adcc4c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e21166-9373-4684-a204-61d4adcc4c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (228c4cbd-4b17-4012-be0e-5ed238483c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:28 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Volume 676f322d-1252-4646-967f-f22edc9a15c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-676f322d-1252-4646-967f-f22edc9a15c3', 'volume_size': 1}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1593816544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676f322d-1252-4646-967f-f22edc9a15c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5511f4f88ff4dc588116f1b1ab3b141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:29Z,use_quota=True,user_id='d248f929223f46178c97134fbf734c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Creating volume 676f322d-1252-4646-967f-f22edc9a15c3 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:00:28 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:00:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-676f322d-1252-4646-967f-f22edc9a15c3 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:28 devstack sudo[100841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-676f322d-1252-4646-967f-f22edc9a15c3 1073741824
Sep 04 16:00:28 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:29 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d69c53fc-6f64-422d-8b77-616c313afbc2 tempest-VolumesTransfersTest-777100485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d422d223-6c10-4470-8a22-25b76fa29eb1" returned: 0 in 0.413s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d69c53fc-6f64-422d-8b77-616c313afbc2 tempest-VolumesTransfersTest-777100485 None] Lock "cinder-quobyte-d422d223-6c10-4470-8a22-25b76fa29eb1" released by "delete_volume" :: held 0.956s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-d69c53fc-6f64-422d-8b77-616c313afbc2 tempest-VolumesTransfersTest-777100485 None] Created reservations ['f767f666-d7cc-4744-859a-174cc89b8181', '3815d5d1-525d-4c6c-be94-82c17a45cb17', 'e23f35f1-8c43-4780-adb2-358b1d6aa0df', '18b3da49-7087-4647-b755-0c4f24608e16'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Flow 'volume_create_manager' (71989995-f9d4-4377-8b12-e16e8fd05d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977c5954-6299-450f-b25a-adfcdd94ef23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977c5954-6299-450f-b25a-adfcdd94ef23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-742605821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7a92c1-d2e3-4934-bdc5-d0bce8bac651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5511f4f88ff4dc588116f1b1ab3b141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:29Z,use_quota=True,user_id='d248f929223f46178c97134fbf734c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b7e614a-8263-4900-8016-18277a49317a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b7e614a-8263-4900-8016-18277a49317a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c337bb8-dfd1-415f-a266-e746aa9d54ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c337bb8-dfd1-415f-a266-e746aa9d54ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed7a92c1-d2e3-4934-bdc5-d0bce8bac651', 'volume_name': 'volume-ed7a92c1-d2e3-4934-bdc5-d0bce8bac651', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d61527f-9667-426e-acae-e9b4f5897b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d61527f-9667-426e-acae-e9b4f5897b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (135407a0-c00e-4cbd-8d23-5cae0b27adaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:29 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Volume ed7a92c1-d2e3-4934-bdc5-d0bce8bac651: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed7a92c1-d2e3-4934-bdc5-d0bce8bac651', 'volume_size': 1}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d69c53fc-6f64-422d-8b77-616c313afbc2 tempest-VolumesTransfersTest-777100485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d69c53fc-6f64-422d-8b77-616c313afbc2 tempest-VolumesTransfersTest-777100485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d69c53fc-6f64-422d-8b77-616c313afbc2 tempest-VolumesTransfersTest-777100485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d69c53fc-6f64-422d-8b77-616c313afbc2 tempest-VolumesTransfersTest-777100485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d69c53fc-6f64-422d-8b77-616c313afbc2 tempest-VolumesTransfersTest-777100485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d69c53fc-6f64-422d-8b77-616c313afbc2 tempest-VolumesTransfersTest-777100485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:29 devstack sudo[100847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:00:29 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:29 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-676f322d-1252-4646-967f-f22edc9a15c3 1073741824" returned: 0 in 0.680s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-676f322d-1252-4646-967f-f22edc9a15c3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:29 devstack sudo[100849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-676f322d-1252-4646-967f-f22edc9a15c3
Sep 04 16:00:29 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:29 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d69c53fc-6f64-422d-8b77-616c313afbc2 tempest-VolumesTransfersTest-777100485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.358s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-d69c53fc-6f64-422d-8b77-616c313afbc2 tempest-VolumesTransfersTest-777100485 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:00:29 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-d69c53fc-6f64-422d-8b77-616c313afbc2 tempest-VolumesTransfersTest-777100485 None] Deleted volume successfully.
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d69c53fc-6f64-422d-8b77-616c313afbc2 tempest-VolumesTransfersTest-777100485 None] Lock "cinder-d422d223-6c10-4470-8a22-25b76fa29eb1-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:29 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-676f322d-1252-4646-967f-f22edc9a15c3" returned: 0 in 0.284s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.607s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-742605821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7a92c1-d2e3-4934-bdc5-d0bce8bac651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5511f4f88ff4dc588116f1b1ab3b141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:29Z,use_quota=True,user_id='d248f929223f46178c97134fbf734c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Creating volume ed7a92c1-d2e3-4934-bdc5-d0bce8bac651 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:00:29 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:00:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ed7a92c1-d2e3-4934-bdc5-d0bce8bac651 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (228c4cbd-4b17-4012-be0e-5ed238483c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-676f322d-1252-4646-967f-f22edc9a15c3', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524cd410-81b7-4e7f-8612-9adef136c6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:30 devstack sudo[100853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ed7a92c1-d2e3-4934-bdc5-d0bce8bac651 1073741824
Sep 04 16:00:30 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:30 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Volume volume-676f322d-1252-4646-967f-f22edc9a15c3 (676f322d-1252-4646-967f-f22edc9a15c3): created successfully
Sep 04 16:00:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524cd410-81b7-4e7f-8612-9adef136c6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Flow 'volume_create_manager' (9e9be5da-e4bb-4900-83ec-f0b71927296f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:00:30 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-86d685e1-b43e-4668-8f24-d22865d66af5 tempest-TestServerVolumeAttachmentScenario-483552951 None] Created volume successfully.
Sep 04 16:00:30 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ed7a92c1-d2e3-4934-bdc5-d0bce8bac651 1073741824" returned: 0 in 0.621s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ed7a92c1-d2e3-4934-bdc5-d0bce8bac651 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:30 devstack sudo[100859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ed7a92c1-d2e3-4934-bdc5-d0bce8bac651
Sep 04 16:00:30 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:30 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ed7a92c1-d2e3-4934-bdc5-d0bce8bac651" returned: 0 in 0.327s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:30 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:00:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (135407a0-c00e-4cbd-8d23-5cae0b27adaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed7a92c1-d2e3-4934-bdc5-d0bce8bac651', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d74dec3-6ece-4495-9c01-dd2c78eb86b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:31 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Volume volume-ed7a92c1-d2e3-4934-bdc5-d0bce8bac651 (ed7a92c1-d2e3-4934-bdc5-d0bce8bac651): created successfully
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d74dec3-6ece-4495-9c01-dd2c78eb86b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Flow 'volume_create_manager' (71989995-f9d4-4377-8b12-e16e8fd05d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:00:31 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-c46f3a6d-8055-4074-a238-52639aac6e3f tempest-TestServerVolumeAttachmentScenario-483552951 None] Created volume successfully.
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Flow 'volume_create_manager' (8d3bffd8-a360-4779-bc55-f3b6980c6938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16678fa8-fa1e-4773-9d79-b1fa129a5561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16678fa8-fa1e-4773-9d79-b1fa129a5561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1706362030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ef9371b-9534-4d26-8273-6b9ff0d14244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='032b7192c80b4d5891c32dd4ba95e129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:31Z,use_quota=True,user_id='ed3c7f8c1af84ca19ec4d80fb42d234c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2f0546f-e655-4c11-88d8-abe025730c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2f0546f-e655-4c11-88d8-abe025730c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0459aba2-1b5f-43e5-9d2e-f2659b1c6721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0459aba2-1b5f-43e5-9d2e-f2659b1c6721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ef9371b-9534-4d26-8273-6b9ff0d14244', 'volume_name': 'volume-5ef9371b-9534-4d26-8273-6b9ff0d14244', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d26c48-afcf-4541-98f4-bde3e820868f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d26c48-afcf-4541-98f4-bde3e820868f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbf78331-ab31-4898-8b15-435e58be80da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:31 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Volume 5ef9371b-9534-4d26-8273-6b9ff0d14244: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ef9371b-9534-4d26-8273-6b9ff0d14244', 'volume_size': 1}
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1706362030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ef9371b-9534-4d26-8273-6b9ff0d14244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='032b7192c80b4d5891c32dd4ba95e129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:31Z,use_quota=True,user_id='ed3c7f8c1af84ca19ec4d80fb42d234c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Creating volume 5ef9371b-9534-4d26-8273-6b9ff0d14244 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:00:31 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5ef9371b-9534-4d26-8273-6b9ff0d14244 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:31 devstack sudo[100862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5ef9371b-9534-4d26-8273-6b9ff0d14244 1073741824
Sep 04 16:00:31 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:31 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5ef9371b-9534-4d26-8273-6b9ff0d14244 1073741824" returned: 0 in 0.528s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5ef9371b-9534-4d26-8273-6b9ff0d14244 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:31 devstack sudo[100868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5ef9371b-9534-4d26-8273-6b9ff0d14244
Sep 04 16:00:31 devstack sudo[100868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:32 devstack sudo[100868]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5ef9371b-9534-4d26-8273-6b9ff0d14244" returned: 0 in 0.295s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:32 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:00:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:32 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbf78331-ab31-4898-8b15-435e58be80da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ef9371b-9534-4d26-8273-6b9ff0d14244', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:32 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef9e20c6-1ef6-4b9f-9f4f-bc25cb14036d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:32 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Volume volume-5ef9371b-9534-4d26-8273-6b9ff0d14244 (5ef9371b-9534-4d26-8273-6b9ff0d14244): created successfully
Sep 04 16:00:32 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef9e20c6-1ef6-4b9f-9f4f-bc25cb14036d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:32 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Flow 'volume_create_manager' (8d3bffd8-a360-4779-bc55-f3b6980c6938) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:00:32 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-735fecc2-541e-4fea-abec-20603dfe3e69 tempest-VolumesTransfersTest-1427503463 None] Created volume successfully.
Sep 04 16:00:33 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8475d7e9-e694-4a33-bf9f-6f3df683b7fc tempest-VolumesTransfersTest-777100485 None] Acquiring lock "cinder-5ef9371b-9534-4d26-8273-6b9ff0d14244-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:33 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8475d7e9-e694-4a33-bf9f-6f3df683b7fc tempest-VolumesTransfersTest-777100485 None] Lock "cinder-5ef9371b-9534-4d26-8273-6b9ff0d14244-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:33 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8475d7e9-e694-4a33-bf9f-6f3df683b7fc tempest-VolumesTransfersTest-777100485 None] Acquiring lock "cinder-quobyte-5ef9371b-9534-4d26-8273-6b9ff0d14244" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:00:33 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8475d7e9-e694-4a33-bf9f-6f3df683b7fc tempest-VolumesTransfersTest-777100485 None] Lock "cinder-quobyte-5ef9371b-9534-4d26-8273-6b9ff0d14244" acquired by "delete_volume" :: waited 0.024s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:00:33 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3778a357-ae92-4cbe-a570-c0b04f3c22ec]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:00:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8475d7e9-e694-4a33-bf9f-6f3df683b7fc tempest-VolumesTransfersTest-777100485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5ef9371b-9534-4d26-8273-6b9ff0d14244 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:33 devstack sudo[100874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5ef9371b-9534-4d26-8273-6b9ff0d14244
Sep 04 16:00:33 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:34 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8475d7e9-e694-4a33-bf9f-6f3df683b7fc tempest-VolumesTransfersTest-777100485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5ef9371b-9534-4d26-8273-6b9ff0d14244" returned: 0 in 0.407s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8475d7e9-e694-4a33-bf9f-6f3df683b7fc tempest-VolumesTransfersTest-777100485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5ef9371b-9534-4d26-8273-6b9ff0d14244 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:34 devstack sudo[100879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5ef9371b-9534-4d26-8273-6b9ff0d14244
Sep 04 16:00:34 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:34 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8475d7e9-e694-4a33-bf9f-6f3df683b7fc tempest-VolumesTransfersTest-777100485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5ef9371b-9534-4d26-8273-6b9ff0d14244" returned: 0 in 0.317s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:34 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8475d7e9-e694-4a33-bf9f-6f3df683b7fc tempest-VolumesTransfersTest-777100485 None] Lock "cinder-quobyte-5ef9371b-9534-4d26-8273-6b9ff0d14244" released by "delete_volume" :: held 0.795s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:34 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-8475d7e9-e694-4a33-bf9f-6f3df683b7fc tempest-VolumesTransfersTest-777100485 None] Created reservations ['4eb4b1e3-3897-439c-9814-d382c09800fb', '2551f705-ef13-4367-b771-77a1dc872676', '9d78df5e-9f9a-4d39-a666-227157b35df8', '41a66e1a-f0a2-4ecd-a036-72bab495a862'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:00:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-8475d7e9-e694-4a33-bf9f-6f3df683b7fc tempest-VolumesTransfersTest-777100485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-8475d7e9-e694-4a33-bf9f-6f3df683b7fc tempest-VolumesTransfersTest-777100485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-8475d7e9-e694-4a33-bf9f-6f3df683b7fc tempest-VolumesTransfersTest-777100485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:00:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-8475d7e9-e694-4a33-bf9f-6f3df683b7fc tempest-VolumesTransfersTest-777100485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:00:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-8475d7e9-e694-4a33-bf9f-6f3df683b7fc tempest-VolumesTransfersTest-777100485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8475d7e9-e694-4a33-bf9f-6f3df683b7fc tempest-VolumesTransfersTest-777100485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:34 devstack sudo[100883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:00:34 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:34 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8475d7e9-e694-4a33-bf9f-6f3df683b7fc tempest-VolumesTransfersTest-777100485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.360s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:34 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-8475d7e9-e694-4a33-bf9f-6f3df683b7fc tempest-VolumesTransfersTest-777100485 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:00:34 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-8475d7e9-e694-4a33-bf9f-6f3df683b7fc tempest-VolumesTransfersTest-777100485 None] Deleted volume successfully.
Sep 04 16:00:34 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8475d7e9-e694-4a33-bf9f-6f3df683b7fc tempest-VolumesTransfersTest-777100485 None] Lock "cinder-5ef9371b-9534-4d26-8273-6b9ff0d14244-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:00:44 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:UPDATE=169,cinder:SELECT=132,cinder:DELETE=13,cinder:INSERT=39 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:00:44 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:UPDATE=165,cinder:DELETE=16,cinder:SELECT=131,cinder:INSERT=47 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:00:48 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 16:00:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:00:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:00:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:48 devstack sudo[100975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:00:48 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:49 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.410s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:49 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:00:49 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager._thread_info {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 16:00:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread count: 28 {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 16:00:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread info: [<_MainThread(MainThread, started 131673838448768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131673724603200)>, <Thread(Thread-3 (stat_writer), started daemon 131673723495936)>, <Thread(Rabbit-heartbeat, started daemon 131673723764800)>, <Thread(Thread-5 (_runner), started daemon 131673722269632)>, <Thread(Thread-7 (_runner), started daemon 131673722322112)>, <Thread(fd_logger, started daemon 131673722585024)>, <Thread(privsep_reader, started daemon 131673721593984)>, <Thread(tpool_thread_0, started daemon 131673714706112)>, <Thread(tpool_thread_1, started daemon 131673706313408)>, <Thread(tpool_thread_2, started daemon 131673697920704)>, <Thread(tpool_thread_3, started daemon 131673689528000)>, <Thread(tpool_thread_4, started daemon 131673681135296)>, <Thread(tpool_thread_5, started daemon 131673672726208)>, <Thread(tpool_thread_6, started daemon 131673664317120)>, <Thread(tpool_thread_7, started daemon 131673655908032)>, <Thread(tpool_thread_8, started daemon 131673647498944)>, <Thread(tpool_thread_9, started daemon 131673639089856)>, <Thread(tpool_thread_10, started daemon 131673630680768)>, <Thread(tpool_thread_11, started daemon 131673622271680)>, <Thread(tpool_thread_12, started daemon 131673613862592)>, <Thread(tpool_thread_13, started daemon 131673605453504)>, <Thread(tpool_thread_14, started daemon 131673597044416)>, <Thread(tpool_thread_15, started daemon 131673588635328)>, <Thread(tpool_thread_16, started daemon 131673580226240)>, <Thread(tpool_thread_17, started daemon 131673571817152)>, <Thread(tpool_thread_18, started daemon 131673563408064)>, <Thread(tpool_thread_19, started daemon 131673554998976)>] {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 16:00:56 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:00:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Flow 'volume_create_manager' (cf77067a-3831-43aa-b6c9-a405817bcc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:00:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44497d0-4d30-4b85-93c6-2f058599acb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44497d0-4d30-4b85-93c6-2f058599acb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1875524875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5395d18c-9b7a-47e5-a5dc-35ed0cbe7594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe6b08b4c544d689b04abc42a5249b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:57Z,use_quota=True,user_id='dfabf743a5814d88985ad4bb3796af29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4124ff-f4da-4b52-a003-179ac0a59706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4124ff-f4da-4b52-a003-179ac0a59706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f94d0869-d052-4ecb-8f26-fcc8ad15615f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f94d0869-d052-4ecb-8f26-fcc8ad15615f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5395d18c-9b7a-47e5-a5dc-35ed0cbe7594', 'volume_name': 'volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f38a17f2-712d-4279-ae5b-391e11eb6613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f38a17f2-712d-4279-ae5b-391e11eb6613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb55c8af-6e96-4c27-9f5b-da54bb6094d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:56 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Volume 5395d18c-9b7a-47e5-a5dc-35ed0cbe7594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594', 'volume_size': 1}
Sep 04 16:00:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1875524875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5395d18c-9b7a-47e5-a5dc-35ed0cbe7594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe6b08b4c544d689b04abc42a5249b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:57Z,use_quota=True,user_id='dfabf743a5814d88985ad4bb3796af29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:00:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Creating volume 5395d18c-9b7a-47e5-a5dc-35ed0cbe7594 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:00:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:00:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:00:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:00:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:00:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:00:56 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:00:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:56 devstack sudo[101023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594 1073741824
Sep 04 16:00:56 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:57 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594 1073741824" returned: 0 in 0.513s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:00:57 devstack sudo[101031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594
Sep 04 16:00:57 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:00:57 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root
Sep 04 16:00:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594" returned: 0 in 0.268s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:00:57 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:00:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:00:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb55c8af-6e96-4c27-9f5b-da54bb6094d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40ea301-6d3e-4e97-bc83-d57a06c511db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:00:57 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Volume volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594 (5395d18c-9b7a-47e5-a5dc-35ed0cbe7594): created successfully
Sep 04 16:00:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40ea301-6d3e-4e97-bc83-d57a06c511db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:00:57 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Flow 'volume_create_manager' (cf77067a-3831-43aa-b6c9-a405817bcc21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:00:57 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-448bbb2c-f27c-4c5a-a965-742be2eaab27 tempest-VolumesActionsTest-648601268 None] Created volume successfully.
Sep 04 16:01:07 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:01:07 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=2,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:01:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-866f5615-55f7-4ac8-9144-28c4df38c5f3 req-80565e24-13eb-4e64-9dfe-1a13b2301048 tempest-TestServerVolumeAttachmentScenario-483552951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:01:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-866f5615-55f7-4ac8-9144-28c4df38c5f3 req-80565e24-13eb-4e64-9dfe-1a13b2301048 tempest-TestServerVolumeAttachmentScenario-483552951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:01:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-866f5615-55f7-4ac8-9144-28c4df38c5f3 req-80565e24-13eb-4e64-9dfe-1a13b2301048 tempest-TestServerVolumeAttachmentScenario-483552951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:01:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-866f5615-55f7-4ac8-9144-28c4df38c5f3 req-80565e24-13eb-4e64-9dfe-1a13b2301048 tempest-TestServerVolumeAttachmentScenario-483552951 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236', 'name': 'volume-676f322d-1252-4646-967f-f22edc9a15c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1de9f72-cd8f-49d8-93b0-f45faa2d92d3', 'enforce_multipath': True} {{(pid=87504) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 16:01:08 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-866f5615-55f7-4ac8-9144-28c4df38c5f3 req-80565e24-13eb-4e64-9dfe-1a13b2301048 tempest-TestServerVolumeAttachmentScenario-483552951 None] attachment_update completed successfully.
Sep 04 16:01:08 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-135b32f8-de69-4692-a1d5-9ad0b9449ba0 tempest-VolumesActionsTest-648601268 None] Acquiring lock "cinder-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594" by "attach_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:01:08 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-135b32f8-de69-4692-a1d5-9ad0b9449ba0 tempest-VolumesActionsTest-648601268 None] Lock "cinder-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594" acquired by "attach_volume" :: waited 0.034s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:01:08 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-135b32f8-de69-4692-a1d5-9ad0b9449ba0 tempest-VolumesActionsTest-648601268 None] Attaching volume 5395d18c-9b7a-47e5-a5dc-35ed0cbe7594 to instance cb7f0e90-64ea-414e-a70d-94e7a22b7657 at mountpoint /dev/vdb on host None.
Sep 04 16:01:08 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-135b32f8-de69-4692-a1d5-9ad0b9449ba0 tempest-VolumesActionsTest-648601268 None] Attach volume completed successfully.
Sep 04 16:01:08 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-135b32f8-de69-4692-a1d5-9ad0b9449ba0 tempest-VolumesActionsTest-648601268 None] Lock "cinder-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594" released by "attach_volume" :: held 0.177s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:01:09 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2e6ff630-96a1-46cb-b19f-3198b7957f8b tempest-VolumesActionsTest-648601268 None] Acquiring lock "cinder-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594-detach_volume" by "detach_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:01:09 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2e6ff630-96a1-46cb-b19f-3198b7957f8b tempest-VolumesActionsTest-648601268 None] Lock "cinder-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:01:09 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-2e6ff630-96a1-46cb-b19f-3198b7957f8b tempest-VolumesActionsTest-648601268 None] Detaching volume 5395d18c-9b7a-47e5-a5dc-35ed0cbe7594 from instance cb7f0e90-64ea-414e-a70d-94e7a22b7657.
Sep 04 16:01:09 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-2e6ff630-96a1-46cb-b19f-3198b7957f8b tempest-VolumesActionsTest-648601268 None] Detach volume completed successfully.
Sep 04 16:01:09 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2e6ff630-96a1-46cb-b19f-3198b7957f8b tempest-VolumesActionsTest-648601268 None] Lock "cinder-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594-detach_volume" released by "detach_volume" :: held 0.218s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:01:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-507e2638-247f-4ba6-bd1a-3979c16ee4df req-1655a72e-dc10-4c27-8057-077fb039651e tempest-TestServerVolumeAttachmentScenario-483552951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:01:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-507e2638-247f-4ba6-bd1a-3979c16ee4df req-1655a72e-dc10-4c27-8057-077fb039651e tempest-TestServerVolumeAttachmentScenario-483552951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:01:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-507e2638-247f-4ba6-bd1a-3979c16ee4df req-1655a72e-dc10-4c27-8057-077fb039651e tempest-TestServerVolumeAttachmentScenario-483552951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:01:15 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-507e2638-247f-4ba6-bd1a-3979c16ee4df req-1655a72e-dc10-4c27-8057-077fb039651e tempest-TestServerVolumeAttachmentScenario-483552951 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236', 'name': 'volume-ed7a92c1-d2e3-4934-bdc5-d0bce8bac651', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd09e6a43-15b2-4915-a570-6c6b54b31b71', 'enforce_multipath': True} {{(pid=87504) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 16:01:15 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-507e2638-247f-4ba6-bd1a-3979c16ee4df req-1655a72e-dc10-4c27-8057-077fb039651e tempest-TestServerVolumeAttachmentScenario-483552951 None] attachment_update completed successfully.
Sep 04 16:01:18 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-f4a55a04-d667-4cca-a4ce-422826125f3d req-d9a8b1d5-3a6a-4fce-98c1-f513ca346417 tempest-TestServerVolumeAttachmentScenario-483552951 None] Terminate volume connection completed successfully.
Sep 04 16:01:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-f4a55a04-d667-4cca-a4ce-422826125f3d req-d9a8b1d5-3a6a-4fce-98c1-f513ca346417 tempest-TestServerVolumeAttachmentScenario-483552951 None] Deleting attachment d09e6a43-15b2-4915-a570-6c6b54b31b71. {{(pid=87504) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 16:01:20 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:01:20 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Flow 'volume_create_manager' (a80a4f7b-c70a-4ca5-be7b-efe804a460a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:01:20 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0f97c1-6439-4c4b-9b8b-100868746ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:01:20 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0f97c1-6439-4c4b-9b8b-100868746ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1907127638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5e6d11-6d92-4a04-8719-4e879401260b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ee27d0292d4a248da71d7c01954e3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:01:20Z,use_quota=True,user_id='f067a7342e4a43118f009c4d3f13025d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:01:20 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20fa5b2c-548d-4c7a-ad1b-a4bdafc9818c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:01:20 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20fa5b2c-548d-4c7a-ad1b-a4bdafc9818c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:01:20 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab522650-5eb6-4eae-8ac8-6c237632dcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:01:20 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab522650-5eb6-4eae-8ac8-6c237632dcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a5e6d11-6d92-4a04-8719-4e879401260b', 'volume_name': 'volume-7a5e6d11-6d92-4a04-8719-4e879401260b', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:01:20 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbe7b3b-dc44-4068-8a52-c2215da6a5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:01:20 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbe7b3b-dc44-4068-8a52-c2215da6a5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:01:20 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01f232c-d3bb-41ff-ac9f-8eb7113059ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:01:20 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Volume 7a5e6d11-6d92-4a04-8719-4e879401260b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a5e6d11-6d92-4a04-8719-4e879401260b', 'volume_size': 1}
Sep 04 16:01:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:01:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:01:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1907127638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5e6d11-6d92-4a04-8719-4e879401260b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ee27d0292d4a248da71d7c01954e3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:01:20Z,use_quota=True,user_id='f067a7342e4a43118f009c4d3f13025d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:01:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Creating volume 7a5e6d11-6d92-4a04-8719-4e879401260b {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:01:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:01:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:01:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:01:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:01:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:01:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:01:20 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:01:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7a5e6d11-6d92-4a04-8719-4e879401260b 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:01:20 devstack sudo[101723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7a5e6d11-6d92-4a04-8719-4e879401260b 1073741824
Sep 04 16:01:20 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:01:20 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root
Sep 04 16:01:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7a5e6d11-6d92-4a04-8719-4e879401260b 1073741824" returned: 0 in 0.731s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:01:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7a5e6d11-6d92-4a04-8719-4e879401260b {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:01:20 devstack sudo[101756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7a5e6d11-6d92-4a04-8719-4e879401260b
Sep 04 16:01:20 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:01:21 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-9ad8181f-0a7c-484a-b303-b30f85b39e6e req-6b4ccafd-cd79-4634-849c-c4d27c1feb0e tempest-TestServerVolumeAttachmentScenario-483552951 None] Terminate volume connection completed successfully.
Sep 04 16:01:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-9ad8181f-0a7c-484a-b303-b30f85b39e6e req-6b4ccafd-cd79-4634-849c-c4d27c1feb0e tempest-TestServerVolumeAttachmentScenario-483552951 None] Deleting attachment c1de9f72-cd8f-49d8-93b0-f45faa2d92d3. {{(pid=87504) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 16:01:21 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root
Sep 04 16:01:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7a5e6d11-6d92-4a04-8719-4e879401260b" returned: 0 in 0.328s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:01:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:01:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:01:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01f232c-d3bb-41ff-ac9f-8eb7113059ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a5e6d11-6d92-4a04-8719-4e879401260b', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:01:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcb2e75c-f1da-488b-93a2-23e7000bd118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:01:21 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Volume volume-7a5e6d11-6d92-4a04-8719-4e879401260b (7a5e6d11-6d92-4a04-8719-4e879401260b): created successfully
Sep 04 16:01:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcb2e75c-f1da-488b-93a2-23e7000bd118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:01:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Flow 'volume_create_manager' (a80a4f7b-c70a-4ca5-be7b-efe804a460a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:01:21 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-acbf768d-430c-4d95-a066-1468453d204f tempest-TestMinimumBasicScenario-814664051 None] Created volume successfully.
Sep 04 16:01:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-9ebc47b9-c46a-410e-a04a-e9e2f682a0ad req-f692a1d6-87d0-4331-85fd-6758f2617c97 tempest-TestMinimumBasicScenario-814664051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:01:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-9ebc47b9-c46a-410e-a04a-e9e2f682a0ad req-f692a1d6-87d0-4331-85fd-6758f2617c97 tempest-TestMinimumBasicScenario-814664051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:01:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-9ebc47b9-c46a-410e-a04a-e9e2f682a0ad req-f692a1d6-87d0-4331-85fd-6758f2617c97 tempest-TestMinimumBasicScenario-814664051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:01:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-9ebc47b9-c46a-410e-a04a-e9e2f682a0ad req-f692a1d6-87d0-4331-85fd-6758f2617c97 tempest-TestMinimumBasicScenario-814664051 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236', 'name': 'volume-7a5e6d11-6d92-4a04-8719-4e879401260b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a02484d3-13a7-4178-8e79-0483cc4c6c29', 'enforce_multipath': True} {{(pid=87504) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 16:01:24 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-9ebc47b9-c46a-410e-a04a-e9e2f682a0ad req-f692a1d6-87d0-4331-85fd-6758f2617c97 tempest-TestMinimumBasicScenario-814664051 None] attachment_update completed successfully.
Sep 04 16:01:30 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-06dea3ce-99f7-4394-a566-b30899400183 tempest-TestServerVolumeAttachmentScenario-483552951 None] Acquiring lock "cinder-ed7a92c1-d2e3-4934-bdc5-d0bce8bac651-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:01:30 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-06dea3ce-99f7-4394-a566-b30899400183 tempest-TestServerVolumeAttachmentScenario-483552951 None] Lock "cinder-ed7a92c1-d2e3-4934-bdc5-d0bce8bac651-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:01:30 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2010dd88-cc6e-4dad-aa22-1d0de712e720 tempest-VolumesActionsTest-648601268 None] Acquiring lock "cinder-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594" by "attach_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:01:30 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2010dd88-cc6e-4dad-aa22-1d0de712e720 tempest-VolumesActionsTest-648601268 None] Lock "cinder-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594" acquired by "attach_volume" :: waited 0.024s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:01:30 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-06dea3ce-99f7-4394-a566-b30899400183 tempest-TestServerVolumeAttachmentScenario-483552951 None] Acquiring lock "cinder-quobyte-ed7a92c1-d2e3-4934-bdc5-d0bce8bac651" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:01:30 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-06dea3ce-99f7-4394-a566-b30899400183 tempest-TestServerVolumeAttachmentScenario-483552951 None] Lock "cinder-quobyte-ed7a92c1-d2e3-4934-bdc5-d0bce8bac651" acquired by "delete_volume" :: waited 0.034s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:01:30 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-2010dd88-cc6e-4dad-aa22-1d0de712e720 tempest-VolumesActionsTest-648601268 None] Attaching volume 5395d18c-9b7a-47e5-a5dc-35ed0cbe7594 to instance 75643516-7507-435a-8c1f-4b5a1e8e8f3b at mountpoint /dev/vdb on host None.
Sep 04 16:01:30 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0277f72f-5583-4bbc-9967-f51c1dfb9113]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:01:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-06dea3ce-99f7-4394-a566-b30899400183 tempest-TestServerVolumeAttachmentScenario-483552951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ed7a92c1-d2e3-4934-bdc5-d0bce8bac651 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:01:30 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-2010dd88-cc6e-4dad-aa22-1d0de712e720 tempest-VolumesActionsTest-648601268 None] Attach volume completed successfully.
Sep 04 16:01:30 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2010dd88-cc6e-4dad-aa22-1d0de712e720 tempest-VolumesActionsTest-648601268 None] Lock "cinder-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594" released by "attach_volume" :: held 0.184s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:01:30 devstack sudo[102273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ed7a92c1-d2e3-4934-bdc5-d0bce8bac651
Sep 04 16:01:30 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:01:30 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4a49240a-76a7-427a-98e2-a1de52bc969a tempest-VolumesActionsTest-648601268 None] Acquiring lock "cinder-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594-detach_volume" by "detach_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:01:30 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4a49240a-76a7-427a-98e2-a1de52bc969a tempest-VolumesActionsTest-648601268 None] Lock "cinder-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:01:30 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-4a49240a-76a7-427a-98e2-a1de52bc969a tempest-VolumesActionsTest-648601268 None] Detaching volume 5395d18c-9b7a-47e5-a5dc-35ed0cbe7594 from instance 75643516-7507-435a-8c1f-4b5a1e8e8f3b.
Sep 04 16:01:31 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-4a49240a-76a7-427a-98e2-a1de52bc969a tempest-VolumesActionsTest-648601268 None] Detach volume completed successfully.
Sep 04 16:01:31 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4a49240a-76a7-427a-98e2-a1de52bc969a tempest-VolumesActionsTest-648601268 None] Lock "cinder-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594-detach_volume" released by "detach_volume" :: held 0.135s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:01:31 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root
Sep 04 16:01:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-06dea3ce-99f7-4394-a566-b30899400183 tempest-TestServerVolumeAttachmentScenario-483552951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ed7a92c1-d2e3-4934-bdc5-d0bce8bac651" returned: 0 in 0.829s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:01:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-06dea3ce-99f7-4394-a566-b30899400183 tempest-TestServerVolumeAttachmentScenario-483552951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ed7a92c1-d2e3-4934-bdc5-d0bce8bac651 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:01:31 devstack sudo[102278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ed7a92c1-d2e3-4934-bdc5-d0bce8bac651
Sep 04 16:01:31 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:01:31 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root
Sep 04 16:01:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-06dea3ce-99f7-4394-a566-b30899400183 tempest-TestServerVolumeAttachmentScenario-483552951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ed7a92c1-d2e3-4934-bdc5-d0bce8bac651" returned: 0 in 0.528s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:01:31 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-06dea3ce-99f7-4394-a566-b30899400183 tempest-TestServerVolumeAttachmentScenario-483552951 None] Lock "cinder-quobyte-ed7a92c1-d2e3-4934-bdc5-d0bce8bac651" released by "delete_volume" :: held 1.432s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:01:31 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-06dea3ce-99f7-4394-a566-b30899400183 tempest-TestServerVolumeAttachmentScenario-483552951 None] Created reservations ['0c824e70-4613-4454-a67c-8fa01fd09f32', '5d324650-e782-48a2-9e0c-9aa35df9c968', '8f925e0f-0c37-4f4c-a760-90117abc4817', '727ef705-a273-4f3f-aec6-e2d94a0f2569'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:01:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-06dea3ce-99f7-4394-a566-b30899400183 tempest-TestServerVolumeAttachmentScenario-483552951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:01:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-06dea3ce-99f7-4394-a566-b30899400183 tempest-TestServerVolumeAttachmentScenario-483552951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:01:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-06dea3ce-99f7-4394-a566-b30899400183 tempest-TestServerVolumeAttachmentScenario-483552951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:01:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-06dea3ce-99f7-4394-a566-b30899400183 tempest-TestServerVolumeAttachmentScenario-483552951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:01:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-06dea3ce-99f7-4394-a566-b30899400183 tempest-TestServerVolumeAttachmentScenario-483552951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:01:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-06dea3ce-99f7-4394-a566-b30899400183 tempest-TestServerVolumeAttachmentScenario-483552951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:01:32 devstack sudo[102291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:01:32 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:01:32 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root
Sep 04 16:01:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-06dea3ce-99f7-4394-a566-b30899400183 tempest-TestServerVolumeAttachmentScenario-483552951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.421s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:01:32 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-06dea3ce-99f7-4394-a566-b30899400183 tempest-TestServerVolumeAttachmentScenario-483552951 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:01:32 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-06dea3ce-99f7-4394-a566-b30899400183 tempest-TestServerVolumeAttachmentScenario-483552951 None] Deleted volume successfully.
Sep 04 16:01:32 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2d17b56c-f9a4-4b5b-9aae-c84842505d66 tempest-TestServerVolumeAttachmentScenario-483552951 None] Acquiring lock "cinder-676f322d-1252-4646-967f-f22edc9a15c3-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:01:32 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-06dea3ce-99f7-4394-a566-b30899400183 tempest-TestServerVolumeAttachmentScenario-483552951 None] Lock "cinder-ed7a92c1-d2e3-4934-bdc5-d0bce8bac651-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:01:32 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2d17b56c-f9a4-4b5b-9aae-c84842505d66 tempest-TestServerVolumeAttachmentScenario-483552951 None] Lock "cinder-676f322d-1252-4646-967f-f22edc9a15c3-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:01:32 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2d17b56c-f9a4-4b5b-9aae-c84842505d66 tempest-TestServerVolumeAttachmentScenario-483552951 None] Acquiring lock "cinder-quobyte-676f322d-1252-4646-967f-f22edc9a15c3" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:01:32 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2d17b56c-f9a4-4b5b-9aae-c84842505d66 tempest-TestServerVolumeAttachmentScenario-483552951 None] Lock "cinder-quobyte-676f322d-1252-4646-967f-f22edc9a15c3" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:01:32 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[054809f2-f1b9-425b-9f4c-4a9b3c0b8dd9]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:01:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d17b56c-f9a4-4b5b-9aae-c84842505d66 tempest-TestServerVolumeAttachmentScenario-483552951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-676f322d-1252-4646-967f-f22edc9a15c3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:01:32 devstack sudo[102305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-676f322d-1252-4646-967f-f22edc9a15c3
Sep 04 16:01:32 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:01:33 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root
Sep 04 16:01:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d17b56c-f9a4-4b5b-9aae-c84842505d66 tempest-TestServerVolumeAttachmentScenario-483552951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-676f322d-1252-4646-967f-f22edc9a15c3" returned: 0 in 0.436s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:01:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d17b56c-f9a4-4b5b-9aae-c84842505d66 tempest-TestServerVolumeAttachmentScenario-483552951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-676f322d-1252-4646-967f-f22edc9a15c3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:01:33 devstack sudo[102310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-676f322d-1252-4646-967f-f22edc9a15c3
Sep 04 16:01:33 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:01:33 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root
Sep 04 16:01:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d17b56c-f9a4-4b5b-9aae-c84842505d66 tempest-TestServerVolumeAttachmentScenario-483552951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-676f322d-1252-4646-967f-f22edc9a15c3" returned: 0 in 0.326s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:01:33 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2d17b56c-f9a4-4b5b-9aae-c84842505d66 tempest-TestServerVolumeAttachmentScenario-483552951 None] Lock "cinder-quobyte-676f322d-1252-4646-967f-f22edc9a15c3" released by "delete_volume" :: held 0.821s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:01:33 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-2d17b56c-f9a4-4b5b-9aae-c84842505d66 tempest-TestServerVolumeAttachmentScenario-483552951 None] Created reservations ['cde70048-bfa7-4eb6-90f3-cb1884d14664', '3a96553c-f2f8-4e38-9727-c68b9f942d73', 'd4465640-c579-4ef3-9ede-7bafb437d80b', '93304adb-5758-4b2b-a28f-3f85db375ac9'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:01:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2d17b56c-f9a4-4b5b-9aae-c84842505d66 tempest-TestServerVolumeAttachmentScenario-483552951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:01:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2d17b56c-f9a4-4b5b-9aae-c84842505d66 tempest-TestServerVolumeAttachmentScenario-483552951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:01:33 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2d17b56c-f9a4-4b5b-9aae-c84842505d66 tempest-TestServerVolumeAttachmentScenario-483552951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:01:33 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2d17b56c-f9a4-4b5b-9aae-c84842505d66 tempest-TestServerVolumeAttachmentScenario-483552951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:01:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2d17b56c-f9a4-4b5b-9aae-c84842505d66 tempest-TestServerVolumeAttachmentScenario-483552951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:01:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d17b56c-f9a4-4b5b-9aae-c84842505d66 tempest-TestServerVolumeAttachmentScenario-483552951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:01:33 devstack sudo[102314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:01:33 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:01:34 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root
Sep 04 16:01:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2d17b56c-f9a4-4b5b-9aae-c84842505d66 tempest-TestServerVolumeAttachmentScenario-483552951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.467s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:01:34 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-2d17b56c-f9a4-4b5b-9aae-c84842505d66 tempest-TestServerVolumeAttachmentScenario-483552951 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:01:34 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-2d17b56c-f9a4-4b5b-9aae-c84842505d66 tempest-TestServerVolumeAttachmentScenario-483552951 None] Deleted volume successfully.
Sep 04 16:01:34 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2d17b56c-f9a4-4b5b-9aae-c84842505d66 tempest-TestServerVolumeAttachmentScenario-483552951 None] Lock "cinder-676f322d-1252-4646-967f-f22edc9a15c3-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:01:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ef6fdb03-37b5-4723-9240-65882b170066 tempest-VolumesActionsTest-648601268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:01:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ef6fdb03-37b5-4723-9240-65882b170066 tempest-VolumesActionsTest-648601268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:01:36 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b970ca-8c34-4698-925f-005306c44a34]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:01:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ef6fdb03-37b5-4723-9240-65882b170066 tempest-VolumesActionsTest-648601268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:01:37 devstack sudo[102321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594
Sep 04 16:01:37 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:01:37 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root
Sep 04 16:01:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ef6fdb03-37b5-4723-9240-65882b170066 tempest-VolumesActionsTest-648601268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594" returned: 0 in 0.382s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:01:37 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc15b67a-a6fa-4b12-971a-f979ba6f2647]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:01:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ef6fdb03-37b5-4723-9240-65882b170066 tempest-VolumesActionsTest-648601268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:01:37 devstack sudo[102326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594
Sep 04 16:01:37 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:01:37 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root
Sep 04 16:01:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ef6fdb03-37b5-4723-9240-65882b170066 tempest-VolumesActionsTest-648601268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594" returned: 0 in 0.425s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:01:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ef6fdb03-37b5-4723-9240-65882b170066 tempest-VolumesActionsTest-648601268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594 /opt/stack/data/cinder/conversion/5395d18c-9b7a-47e5-a5dc-35ed0cbe7594.temp_image.18e05056-4e0c-413e-8a79-6d24e15589b94uohhxhx.img {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:01:37 devstack sudo[102332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594 /opt/stack/data/cinder/conversion/5395d18c-9b7a-47e5-a5dc-35ed0cbe7594.temp_image.18e05056-4e0c-413e-8a79-6d24e15589b94uohhxhx.img
Sep 04 16:01:37 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:01:43 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root
Sep 04 16:01:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ef6fdb03-37b5-4723-9240-65882b170066 tempest-VolumesActionsTest-648601268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594 /opt/stack/data/cinder/conversion/5395d18c-9b7a-47e5-a5dc-35ed0cbe7594.temp_image.18e05056-4e0c-413e-8a79-6d24e15589b94uohhxhx.img" returned: 0 in 5.475s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:01:43 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac73ca1f-7649-42dc-848a-4f8361ff01db]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:01:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ef6fdb03-37b5-4723-9240-65882b170066 tempest-VolumesActionsTest-648601268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:01:43 devstack sudo[102357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594
Sep 04 16:01:43 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:01:43 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root
Sep 04 16:01:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ef6fdb03-37b5-4723-9240-65882b170066 tempest-VolumesActionsTest-648601268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594" returned: 0 in 0.563s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:01:43 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-ef6fdb03-37b5-4723-9240-65882b170066 tempest-VolumesActionsTest-648601268 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594, size 1024.00 MB, duration 5.48 sec, destination /opt/stack/data/cinder/conversion/5395d18c-9b7a-47e5-a5dc-35ed0cbe7594.temp_image.18e05056-4e0c-413e-8a79-6d24e15589b94uohhxhx.img {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 16:01:43 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-ef6fdb03-37b5-4723-9240-65882b170066 tempest-VolumesActionsTest-648601268 None] Converted 1024.00 MB image at 186.99 MB/s
Sep 04 16:01:43 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-ef6fdb03-37b5-4723-9240-65882b170066 tempest-VolumesActionsTest-648601268 None] 18e05056-4e0c-413e-8a79-6d24e15589b9 was raw, no need to convert to raw {{(pid=87504) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Sep 04 16:01:46 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=50,cinder:UPDATE=26,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:01:48 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 16:01:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:01:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:01:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:01:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:01:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:01:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:01:48 devstack sudo[102417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:01:48 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:01:49 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root
Sep 04 16:01:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.440s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:01:49 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:01:49 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager._thread_info {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 16:01:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread count: 28 {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 16:01:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread info: [<_MainThread(MainThread, started 131673838448768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131673724603200)>, <Thread(Thread-3 (stat_writer), started daemon 131673723495936)>, <Thread(Rabbit-heartbeat, started daemon 131673723764800)>, <Thread(Thread-5 (_runner), started daemon 131673722269632)>, <Thread(Thread-7 (_runner), started daemon 131673722322112)>, <Thread(fd_logger, started daemon 131673722585024)>, <Thread(privsep_reader, started daemon 131673721593984)>, <Thread(tpool_thread_0, started daemon 131673714706112)>, <Thread(tpool_thread_1, started daemon 131673706313408)>, <Thread(tpool_thread_2, started daemon 131673697920704)>, <Thread(tpool_thread_3, started daemon 131673689528000)>, <Thread(tpool_thread_4, started daemon 131673681135296)>, <Thread(tpool_thread_5, started daemon 131673672726208)>, <Thread(tpool_thread_6, started daemon 131673664317120)>, <Thread(tpool_thread_7, started daemon 131673655908032)>, <Thread(tpool_thread_8, started daemon 131673647498944)>, <Thread(tpool_thread_9, started daemon 131673639089856)>, <Thread(tpool_thread_10, started daemon 131673630680768)>, <Thread(tpool_thread_11, started daemon 131673622271680)>, <Thread(tpool_thread_12, started daemon 131673613862592)>, <Thread(tpool_thread_13, started daemon 131673605453504)>, <Thread(tpool_thread_14, started daemon 131673597044416)>, <Thread(tpool_thread_15, started daemon 131673588635328)>, <Thread(tpool_thread_16, started daemon 131673580226240)>, <Thread(tpool_thread_17, started daemon 131673571817152)>, <Thread(tpool_thread_18, started daemon 131673563408064)>, <Thread(tpool_thread_19, started daemon 131673554998976)>] {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 16:01:53 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=46,cinder:UPDATE=33,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:02:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ef6fdb03-37b5-4723-9240-65882b170066 tempest-VolumesActionsTest-648601268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.832s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:02:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ef6fdb03-37b5-4723-9240-65882b170066 tempest-VolumesActionsTest-648601268 None] Uploaded volume to glance image-id: 18e05056-4e0c-413e-8a79-6d24e15589b9. {{(pid=87504) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 04 16:02:09 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-ef6fdb03-37b5-4723-9240-65882b170066 tempest-VolumesActionsTest-648601268 None] Copy volume to image completed successfully.
Sep 04 16:02:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:02:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:02:12 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[82273ae5-978c-4140-a018-4224ba7470cd]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:02:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:12 devstack sudo[102468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594
Sep 04 16:02:12 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:12 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594" returned: 0 in 0.462s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:12 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c003a3-950f-4184-87c6-0d7ef2c02bf3]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:02:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:12 devstack sudo[102473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594
Sep 04 16:02:12 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:13 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594" returned: 0 in 0.493s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594 /opt/stack/data/cinder/conversion/5395d18c-9b7a-47e5-a5dc-35ed0cbe7594.temp_image.1d8ab875-f453-4f5a-a786-3836d11eef1fryvntyg0.img {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:13 devstack sudo[102478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594 /opt/stack/data/cinder/conversion/5395d18c-9b7a-47e5-a5dc-35ed0cbe7594.temp_image.1d8ab875-f453-4f5a-a786-3836d11eef1fryvntyg0.img
Sep 04 16:02:13 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:18 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-3b906486-16b1-42a8-8cc8-b1b2f90f915f req-676e3d37-2c95-43a4-a487-8666f9616b20 tempest-TestMinimumBasicScenario-814664051 None] Terminate volume connection completed successfully.
Sep 04 16:02:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-3b906486-16b1-42a8-8cc8-b1b2f90f915f req-676e3d37-2c95-43a4-a487-8666f9616b20 tempest-TestMinimumBasicScenario-814664051 None] Deleting attachment a02484d3-13a7-4178-8e79-0483cc4c6c29. {{(pid=87504) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 16:02:19 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594 /opt/stack/data/cinder/conversion/5395d18c-9b7a-47e5-a5dc-35ed0cbe7594.temp_image.1d8ab875-f453-4f5a-a786-3836d11eef1fryvntyg0.img" returned: 0 in 6.202s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:19 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2b8508-9e6c-43df-9a99-b5c983ab608d]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:02:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:19 devstack sudo[102498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594
Sep 04 16:02:19 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bbb4f923-8bca-4879-a6e6-8bfdeb934376 tempest-TestMinimumBasicScenario-814664051 None] Acquiring lock "cinder-7a5e6d11-6d92-4a04-8719-4e879401260b-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:02:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bbb4f923-8bca-4879-a6e6-8bfdeb934376 tempest-TestMinimumBasicScenario-814664051 None] Lock "cinder-7a5e6d11-6d92-4a04-8719-4e879401260b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:02:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bbb4f923-8bca-4879-a6e6-8bfdeb934376 tempest-TestMinimumBasicScenario-814664051 None] Acquiring lock "cinder-quobyte-7a5e6d11-6d92-4a04-8719-4e879401260b" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:02:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bbb4f923-8bca-4879-a6e6-8bfdeb934376 tempest-TestMinimumBasicScenario-814664051 None] Lock "cinder-quobyte-7a5e6d11-6d92-4a04-8719-4e879401260b" acquired by "delete_volume" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:02:20 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca61755-25be-44bb-be6d-741804e19a80]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:02:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bbb4f923-8bca-4879-a6e6-8bfdeb934376 tempest-TestMinimumBasicScenario-814664051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7a5e6d11-6d92-4a04-8719-4e879401260b {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:20 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594" returned: 0 in 0.803s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:20 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/conversion/5395d18c-9b7a-47e5-a5dc-35ed0cbe7594.temp_image.1d8ab875-f453-4f5a-a786-3836d11eef1fryvntyg0.img {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 16:02:20 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] Converted 1024.00 MB image at 165.09 MB/s
Sep 04 16:02:20 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] 1d8ab875-f453-4f5a-a786-3836d11eef1f was raw, converting to qcow2 {{(pid=87504) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Sep 04 16:02:20 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeea1ed0-bac3-4238-911c-9c64fe871cdf]: (4, 'raw') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:02:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5395d18c-9b7a-47e5-a5dc-35ed0cbe7594.temp_image.1d8ab875-f453-4f5a-a786-3836d11eef1fryvntyg0.img {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:20 devstack sudo[102511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7a5e6d11-6d92-4a04-8719-4e879401260b
Sep 04 16:02:20 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:20 devstack sudo[102512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5395d18c-9b7a-47e5-a5dc-35ed0cbe7594.temp_image.1d8ab875-f453-4f5a-a786-3836d11eef1fryvntyg0.img
Sep 04 16:02:20 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:20 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bbb4f923-8bca-4879-a6e6-8bfdeb934376 tempest-TestMinimumBasicScenario-814664051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7a5e6d11-6d92-4a04-8719-4e879401260b" returned: 0 in 0.435s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bbb4f923-8bca-4879-a6e6-8bfdeb934376 tempest-TestMinimumBasicScenario-814664051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7a5e6d11-6d92-4a04-8719-4e879401260b {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:20 devstack sudo[102520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7a5e6d11-6d92-4a04-8719-4e879401260b
Sep 04 16:02:20 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:20 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5395d18c-9b7a-47e5-a5dc-35ed0cbe7594.temp_image.1d8ab875-f453-4f5a-a786-3836d11eef1fryvntyg0.img" returned: 0 in 0.422s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5395d18c-9b7a-47e5-a5dc-35ed0cbe7594.temp_image.1d8ab875-f453-4f5a-a786-3836d11eef1fryvntyg0.img {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:20 devstack sudo[102522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5395d18c-9b7a-47e5-a5dc-35ed0cbe7594.temp_image.1d8ab875-f453-4f5a-a786-3836d11eef1fryvntyg0.img
Sep 04 16:02:20 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:20 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bbb4f923-8bca-4879-a6e6-8bfdeb934376 tempest-TestMinimumBasicScenario-814664051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7a5e6d11-6d92-4a04-8719-4e879401260b" returned: 0 in 0.290s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bbb4f923-8bca-4879-a6e6-8bfdeb934376 tempest-TestMinimumBasicScenario-814664051 None] Lock "cinder-quobyte-7a5e6d11-6d92-4a04-8719-4e879401260b" released by "delete_volume" :: held 0.795s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:02:20 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-bbb4f923-8bca-4879-a6e6-8bfdeb934376 tempest-TestMinimumBasicScenario-814664051 None] Created reservations ['336379fd-98f8-4e58-9daf-2643f785e3db', 'e425d473-1b48-41f4-a4cd-9d72b5b13482', '28766744-cf53-404b-abb7-c09c16657a0a', '8860c61e-0e93-4615-9f3e-c0200295452f'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:02:20 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5395d18c-9b7a-47e5-a5dc-35ed0cbe7594.temp_image.1d8ab875-f453-4f5a-a786-3836d11eef1fryvntyg0.img" returned: 1 in 0.355s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5395d18c-9b7a-47e5-a5dc-35ed0cbe7594.temp_image.1d8ab875-f453-4f5a-a786-3836d11eef1fryvntyg0.img' failed. Not Retrying. {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 16:02:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5395d18c-9b7a-47e5-a5dc-35ed0cbe7594.temp_image.1d8ab875-f453-4f5a-a786-3836d11eef1fryvntyg0.img /opt/stack/data/cinder/conversion/vol_upload_knvl3599 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:21 devstack sudo[102528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5395d18c-9b7a-47e5-a5dc-35ed0cbe7594.temp_image.1d8ab875-f453-4f5a-a786-3836d11eef1fryvntyg0.img /opt/stack/data/cinder/conversion/vol_upload_knvl3599
Sep 04 16:02:21 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bbb4f923-8bca-4879-a6e6-8bfdeb934376 tempest-TestMinimumBasicScenario-814664051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:02:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bbb4f923-8bca-4879-a6e6-8bfdeb934376 tempest-TestMinimumBasicScenario-814664051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:02:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bbb4f923-8bca-4879-a6e6-8bfdeb934376 tempest-TestMinimumBasicScenario-814664051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:02:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bbb4f923-8bca-4879-a6e6-8bfdeb934376 tempest-TestMinimumBasicScenario-814664051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:02:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bbb4f923-8bca-4879-a6e6-8bfdeb934376 tempest-TestMinimumBasicScenario-814664051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:02:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bbb4f923-8bca-4879-a6e6-8bfdeb934376 tempest-TestMinimumBasicScenario-814664051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:21 devstack sudo[102530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:02:21 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:21 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5395d18c-9b7a-47e5-a5dc-35ed0cbe7594.temp_image.1d8ab875-f453-4f5a-a786-3836d11eef1fryvntyg0.img /opt/stack/data/cinder/conversion/vol_upload_knvl3599" returned: 0 in 0.294s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:21 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] Image conversion details: src /opt/stack/data/cinder/conversion/5395d18c-9b7a-47e5-a5dc-35ed0cbe7594.temp_image.1d8ab875-f453-4f5a-a786-3836d11eef1fryvntyg0.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_knvl3599 {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 16:02:21 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 04 16:02:21 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c59bda7-ee7c-4649-9143-2d20ef5b2c4c]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:02:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_knvl3599 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:21 devstack sudo[102536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_knvl3599
Sep 04 16:02:21 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:21 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bbb4f923-8bca-4879-a6e6-8bfdeb934376 tempest-TestMinimumBasicScenario-814664051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.424s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:21 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-bbb4f923-8bca-4879-a6e6-8bfdeb934376 tempest-TestMinimumBasicScenario-814664051 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:02:21 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-bbb4f923-8bca-4879-a6e6-8bfdeb934376 tempest-TestMinimumBasicScenario-814664051 None] Deleted volume successfully.
Sep 04 16:02:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bbb4f923-8bca-4879-a6e6-8bfdeb934376 tempest-TestMinimumBasicScenario-814664051 None] Lock "cinder-7a5e6d11-6d92-4a04-8719-4e879401260b-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:02:21 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_knvl3599" returned: 0 in 0.396s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.428s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:02:23 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] Uploaded volume to glance image-id: 1d8ab875-f453-4f5a-a786-3836d11eef1f. {{(pid=87504) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 04 16:02:23 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-3100c49b-b836-4be9-93a9-adce367961d3 tempest-VolumesActionsTest-648601268 None] Copy volume to image completed successfully.
Sep 04 16:02:23 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:02:23 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Flow 'volume_create_manager' (01e24714-4d44-4836-9abd-782e2a9dcefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:02:23 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de1f2c56-e9d8-4602-a1fb-22dd49378998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:23 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de1f2c56-e9d8-4602-a1fb-22dd49378998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1586162267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7effc614-7270-4918-b415-95a8238c156e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f914e0bf1d84cb6b1172a1379b403d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:24Z,use_quota=True,user_id='9ba6732a6c1c46ff9a242c69db1890c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:23 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a07c9a-4aea-49d8-9f84-c35b2d5766a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:23 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a07c9a-4aea-49d8-9f84-c35b2d5766a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:23 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b515a7-f231-40d6-b16a-022ac51a698b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:23 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b515a7-f231-40d6-b16a-022ac51a698b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7effc614-7270-4918-b415-95a8238c156e', 'volume_name': 'volume-7effc614-7270-4918-b415-95a8238c156e', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:23 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (543ca35e-aa6b-44b4-b6ee-7c6da7fcac7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:23 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (543ca35e-aa6b-44b4-b6ee-7c6da7fcac7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:23 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ba0cfe-6b42-46da-a1da-5284eb0a7351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:23 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Volume 7effc614-7270-4918-b415-95a8238c156e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7effc614-7270-4918-b415-95a8238c156e', 'volume_size': 1}
Sep 04 16:02:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:02:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:02:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1586162267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7effc614-7270-4918-b415-95a8238c156e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f914e0bf1d84cb6b1172a1379b403d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:24Z,use_quota=True,user_id='9ba6732a6c1c46ff9a242c69db1890c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:02:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Creating volume 7effc614-7270-4918-b415-95a8238c156e {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:02:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:02:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:02:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:02:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:02:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:02:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:02:23 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:02:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:23 devstack sudo[102568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e 1073741824
Sep 04 16:02:23 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:24 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e 1073741824" returned: 0 in 0.550s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:24 devstack sudo[102574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e
Sep 04 16:02:24 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0031c1d0-39d7-4711-ae6a-72a55fe2bbd2 tempest-VolumesActionsTest-648601268 None] Acquiring lock "cinder-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:02:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0031c1d0-39d7-4711-ae6a-72a55fe2bbd2 tempest-VolumesActionsTest-648601268 None] Lock "cinder-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:02:25 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e" returned: 0 in 0.516s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:25 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:02:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:02:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ba0cfe-6b42-46da-a1da-5284eb0a7351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7effc614-7270-4918-b415-95a8238c156e', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9adf225f-d5b1-43e3-a90c-99f01ac4c603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:25 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Volume volume-7effc614-7270-4918-b415-95a8238c156e (7effc614-7270-4918-b415-95a8238c156e): created successfully
Sep 04 16:02:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9adf225f-d5b1-43e3-a90c-99f01ac4c603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Flow 'volume_create_manager' (01e24714-4d44-4836-9abd-782e2a9dcefc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:02:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0031c1d0-39d7-4711-ae6a-72a55fe2bbd2 tempest-VolumesActionsTest-648601268 None] Acquiring lock "cinder-quobyte-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:02:25 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-612aabe3-601c-48a7-8bae-d13b4b114c34 tempest-TestStampPattern-391961132 None] Created volume successfully.
Sep 04 16:02:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0031c1d0-39d7-4711-ae6a-72a55fe2bbd2 tempest-VolumesActionsTest-648601268 None] Lock "cinder-quobyte-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594" acquired by "delete_volume" :: waited 0.022s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:02:25 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdc9303-d1f0-4b1e-9c72-8a4b83ec4895]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:02:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0031c1d0-39d7-4711-ae6a-72a55fe2bbd2 tempest-VolumesActionsTest-648601268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:25 devstack sudo[102580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594
Sep 04 16:02:25 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:25 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0031c1d0-39d7-4711-ae6a-72a55fe2bbd2 tempest-VolumesActionsTest-648601268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594" returned: 0 in 0.432s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0031c1d0-39d7-4711-ae6a-72a55fe2bbd2 tempest-VolumesActionsTest-648601268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:25 devstack sudo[102585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594
Sep 04 16:02:25 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:25 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0031c1d0-39d7-4711-ae6a-72a55fe2bbd2 tempest-VolumesActionsTest-648601268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594" returned: 0 in 0.363s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:26 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0031c1d0-39d7-4711-ae6a-72a55fe2bbd2 tempest-VolumesActionsTest-648601268 None] Lock "cinder-quobyte-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594" released by "delete_volume" :: held 0.851s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:02:26 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-0031c1d0-39d7-4711-ae6a-72a55fe2bbd2 tempest-VolumesActionsTest-648601268 None] Created reservations ['7fffeb6e-0dc0-4e6d-8442-1e22ee6ffdaf', '71dd7715-9a11-4bb1-9a2e-dead243c2841', '07275699-5ac3-4328-9765-e8372b4923c1', 'd089b591-0d98-451a-9313-82ecd63889bd'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:02:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0031c1d0-39d7-4711-ae6a-72a55fe2bbd2 tempest-VolumesActionsTest-648601268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:02:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0031c1d0-39d7-4711-ae6a-72a55fe2bbd2 tempest-VolumesActionsTest-648601268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:02:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0031c1d0-39d7-4711-ae6a-72a55fe2bbd2 tempest-VolumesActionsTest-648601268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:02:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0031c1d0-39d7-4711-ae6a-72a55fe2bbd2 tempest-VolumesActionsTest-648601268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:02:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0031c1d0-39d7-4711-ae6a-72a55fe2bbd2 tempest-VolumesActionsTest-648601268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:02:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0031c1d0-39d7-4711-ae6a-72a55fe2bbd2 tempest-VolumesActionsTest-648601268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:26 devstack sudo[102588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:02:26 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:26 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0031c1d0-39d7-4711-ae6a-72a55fe2bbd2 tempest-VolumesActionsTest-648601268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.302s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:26 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-0031c1d0-39d7-4711-ae6a-72a55fe2bbd2 tempest-VolumesActionsTest-648601268 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:02:26 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-0031c1d0-39d7-4711-ae6a-72a55fe2bbd2 tempest-VolumesActionsTest-648601268 None] Deleted volume successfully.
Sep 04 16:02:26 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-0031c1d0-39d7-4711-ae6a-72a55fe2bbd2 tempest-VolumesActionsTest-648601268 None] Lock "cinder-5395d18c-9b7a-47e5-a5dc-35ed0cbe7594-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:02:37 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=18,cinder:UPDATE=22,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:02:37 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=14,cinder:UPDATE=19,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:02:41 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:02:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Flow 'volume_create_manager' (214a636e-7e1d-4303-8c32-c3050ee76ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:02:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c24497a0-2940-49f9-a5cf-57e6c2d2c849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c24497a0-2940-49f9-a5cf-57e6c2d2c849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1509711296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d9df09-0eab-4d1a-8618-90a7aec16708,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fc4626147fcf454aa7ee1639be8656b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:41Z,use_quota=True,user_id='318a5b2a95044b12beefd3984fd66891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca16bb23-2852-4631-87a0-bd0c985ea661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca16bb23-2852-4631-87a0-bd0c985ea661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c658d69-f5c6-4e9c-aa90-e95d2d3accd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c658d69-f5c6-4e9c-aa90-e95d2d3accd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94d9df09-0eab-4d1a-8618-90a7aec16708', 'volume_name': 'volume-94d9df09-0eab-4d1a-8618-90a7aec16708', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2197cb5f-39dc-488c-b4ca-77da33767a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2197cb5f-39dc-488c-b4ca-77da33767a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9eeeb9-1791-4ada-80d6-878970429f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:41 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Volume 94d9df09-0eab-4d1a-8618-90a7aec16708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94d9df09-0eab-4d1a-8618-90a7aec16708', 'volume_size': 1}
Sep 04 16:02:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:02:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:02:41 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1509711296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d9df09-0eab-4d1a-8618-90a7aec16708,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fc4626147fcf454aa7ee1639be8656b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:41Z,use_quota=True,user_id='318a5b2a95044b12beefd3984fd66891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:02:41 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Creating volume 94d9df09-0eab-4d1a-8618-90a7aec16708 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:02:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:02:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:02:41 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:02:41 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:02:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:02:41 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:02:41 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:02:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-94d9df09-0eab-4d1a-8618-90a7aec16708 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:41 devstack sudo[102685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-94d9df09-0eab-4d1a-8618-90a7aec16708 1073741824
Sep 04 16:02:41 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:42 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-94d9df09-0eab-4d1a-8618-90a7aec16708 1073741824" returned: 0 in 0.841s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-94d9df09-0eab-4d1a-8618-90a7aec16708 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:42 devstack sudo[102699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-94d9df09-0eab-4d1a-8618-90a7aec16708
Sep 04 16:02:42 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:42 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-94d9df09-0eab-4d1a-8618-90a7aec16708" returned: 0 in 0.456s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:02:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:02:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9eeeb9-1791-4ada-80d6-878970429f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94d9df09-0eab-4d1a-8618-90a7aec16708', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a81804-b11e-46df-94dc-d28932005c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:42 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Volume volume-94d9df09-0eab-4d1a-8618-90a7aec16708 (94d9df09-0eab-4d1a-8618-90a7aec16708): created successfully
Sep 04 16:02:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a81804-b11e-46df-94dc-d28932005c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Flow 'volume_create_manager' (214a636e-7e1d-4303-8c32-c3050ee76ebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:02:42 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-cbae4bff-947a-443a-b64d-76423a919d19 tempest-VolumesListTestJSON-632300541 None] Created volume successfully.
Sep 04 16:02:43 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:02:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Flow 'volume_create_manager' (62bb08fb-9493-4705-81d8-1023acb09340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:02:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b12a13-859b-4b21-ae17-310b304531bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b12a13-859b-4b21-ae17-310b304531bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1932609564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=717dba2a-a3bf-4d0e-b663-c1d0c363b890,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fc4626147fcf454aa7ee1639be8656b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:44Z,use_quota=True,user_id='318a5b2a95044b12beefd3984fd66891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5133a0d-bdf5-4736-bc6b-5ec6ce62ef76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5133a0d-bdf5-4736-bc6b-5ec6ce62ef76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c233282-43df-4e60-af37-d66fd1893706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c233282-43df-4e60-af37-d66fd1893706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '717dba2a-a3bf-4d0e-b663-c1d0c363b890', 'volume_name': 'volume-717dba2a-a3bf-4d0e-b663-c1d0c363b890', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b245b6ce-909b-41fd-80b6-b70450b1e548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b245b6ce-909b-41fd-80b6-b70450b1e548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816ff6c4-adb0-43b8-8bcc-0148423466c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:44 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Volume 717dba2a-a3bf-4d0e-b663-c1d0c363b890: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-717dba2a-a3bf-4d0e-b663-c1d0c363b890', 'volume_size': 1}
Sep 04 16:02:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:02:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:02:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1932609564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=717dba2a-a3bf-4d0e-b663-c1d0c363b890,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fc4626147fcf454aa7ee1639be8656b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:44Z,use_quota=True,user_id='318a5b2a95044b12beefd3984fd66891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:02:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Creating volume 717dba2a-a3bf-4d0e-b663-c1d0c363b890 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:02:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:02:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:02:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:02:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:02:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:02:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:02:44 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:02:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-717dba2a-a3bf-4d0e-b663-c1d0c363b890 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:44 devstack sudo[102706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-717dba2a-a3bf-4d0e-b663-c1d0c363b890 1073741824
Sep 04 16:02:44 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:44 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-717dba2a-a3bf-4d0e-b663-c1d0c363b890 1073741824" returned: 0 in 0.480s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-717dba2a-a3bf-4d0e-b663-c1d0c363b890 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:44 devstack sudo[102713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-717dba2a-a3bf-4d0e-b663-c1d0c363b890
Sep 04 16:02:44 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:44 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-717dba2a-a3bf-4d0e-b663-c1d0c363b890" returned: 0 in 0.267s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:02:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:02:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816ff6c4-adb0-43b8-8bcc-0148423466c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-717dba2a-a3bf-4d0e-b663-c1d0c363b890', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc3775e0-9435-4f90-a3e1-760ce3e88e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:44 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Volume volume-717dba2a-a3bf-4d0e-b663-c1d0c363b890 (717dba2a-a3bf-4d0e-b663-c1d0c363b890): created successfully
Sep 04 16:02:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc3775e0-9435-4f90-a3e1-760ce3e88e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Flow 'volume_create_manager' (62bb08fb-9493-4705-81d8-1023acb09340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:02:44 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f4908990-b311-4823-a757-6cc2643f35b6 tempest-VolumesListTestJSON-632300541 None] Created volume successfully.
Sep 04 16:02:46 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:02:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Flow 'volume_create_manager' (b4ebdee4-56a4-4e6f-83f5-2433424953a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:02:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e6ac5d-f0ae-4774-b6cf-0a4c895857ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e6ac5d-f0ae-4774-b6cf-0a4c895857ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1023995807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fc4626147fcf454aa7ee1639be8656b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:47Z,use_quota=True,user_id='318a5b2a95044b12beefd3984fd66891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e7e8130-0700-4329-a27d-f4bc7487a5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e7e8130-0700-4329-a27d-f4bc7487a5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345e7a0f-ebb3-4818-907a-22ecb3f9710e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345e7a0f-ebb3-4818-907a-22ecb3f9710e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6', 'volume_name': 'volume-dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c4d81a-4c92-4fa3-a2cc-8449ed424d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c4d81a-4c92-4fa3-a2cc-8449ed424d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fbff9da-ec7b-459d-9941-8a13cea098c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:47 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Volume dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6', 'volume_size': 1}
Sep 04 16:02:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:02:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:02:47 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1023995807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fc4626147fcf454aa7ee1639be8656b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:47Z,use_quota=True,user_id='318a5b2a95044b12beefd3984fd66891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:02:47 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Creating volume dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:02:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:02:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:02:47 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:02:47 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:02:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:02:47 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:02:47 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:02:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:47 devstack sudo[102716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6 1073741824
Sep 04 16:02:47 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:47 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6 1073741824" returned: 0 in 0.452s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:47 devstack sudo[102721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6
Sep 04 16:02:47 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:47 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6" returned: 0 in 0.263s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:47 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:02:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:02:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fbff9da-ec7b-459d-9941-8a13cea098c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d98ff5-9769-40b8-9349-350a1c42cb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:47 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Volume volume-dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6 (dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6): created successfully
Sep 04 16:02:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d98ff5-9769-40b8-9349-350a1c42cb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Flow 'volume_create_manager' (b4ebdee4-56a4-4e6f-83f5-2433424953a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:02:47 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e14b477e-05ee-4a1c-8d68-45183fbe9558 tempest-VolumesListTestJSON-632300541 None] Created volume successfully.
Sep 04 16:02:48 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 16:02:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:02:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:02:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:02:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:02:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:02:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:48 devstack sudo[102746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:02:48 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:49 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.308s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:49 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:02:49 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager._thread_info {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 16:02:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread count: 28 {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 16:02:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread info: [<_MainThread(MainThread, started 131673838448768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131673724603200)>, <Thread(Thread-3 (stat_writer), started daemon 131673723495936)>, <Thread(Rabbit-heartbeat, started daemon 131673723764800)>, <Thread(Thread-5 (_runner), started daemon 131673722269632)>, <Thread(Thread-7 (_runner), started daemon 131673722322112)>, <Thread(fd_logger, started daemon 131673722585024)>, <Thread(privsep_reader, started daemon 131673721593984)>, <Thread(tpool_thread_0, started daemon 131673714706112)>, <Thread(tpool_thread_1, started daemon 131673706313408)>, <Thread(tpool_thread_2, started daemon 131673697920704)>, <Thread(tpool_thread_3, started daemon 131673689528000)>, <Thread(tpool_thread_4, started daemon 131673681135296)>, <Thread(tpool_thread_5, started daemon 131673672726208)>, <Thread(tpool_thread_6, started daemon 131673664317120)>, <Thread(tpool_thread_7, started daemon 131673655908032)>, <Thread(tpool_thread_8, started daemon 131673647498944)>, <Thread(tpool_thread_9, started daemon 131673639089856)>, <Thread(tpool_thread_10, started daemon 131673630680768)>, <Thread(tpool_thread_11, started daemon 131673622271680)>, <Thread(tpool_thread_12, started daemon 131673613862592)>, <Thread(tpool_thread_13, started daemon 131673605453504)>, <Thread(tpool_thread_14, started daemon 131673597044416)>, <Thread(tpool_thread_15, started daemon 131673588635328)>, <Thread(tpool_thread_16, started daemon 131673580226240)>, <Thread(tpool_thread_17, started daemon 131673571817152)>, <Thread(tpool_thread_18, started daemon 131673563408064)>, <Thread(tpool_thread_19, started daemon 131673554998976)>] {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 16:02:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d52e7694-5b00-4e99-9e90-fcd13e477904 tempest-VolumesListTestJSON-632300541 None] Acquiring lock "cinder-dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:02:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d52e7694-5b00-4e99-9e90-fcd13e477904 tempest-VolumesListTestJSON-632300541 None] Lock "cinder-dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:02:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d52e7694-5b00-4e99-9e90-fcd13e477904 tempest-VolumesListTestJSON-632300541 None] Acquiring lock "cinder-quobyte-dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:02:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d52e7694-5b00-4e99-9e90-fcd13e477904 tempest-VolumesListTestJSON-632300541 None] Lock "cinder-quobyte-dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6" acquired by "delete_volume" :: waited 0.015s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:02:51 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c88838c-188c-495e-9ea0-2caca5d0d56f]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:02:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d52e7694-5b00-4e99-9e90-fcd13e477904 tempest-VolumesListTestJSON-632300541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:51 devstack sudo[102750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6
Sep 04 16:02:51 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:51 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d52e7694-5b00-4e99-9e90-fcd13e477904 tempest-VolumesListTestJSON-632300541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6" returned: 0 in 0.410s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d52e7694-5b00-4e99-9e90-fcd13e477904 tempest-VolumesListTestJSON-632300541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:51 devstack sudo[102755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6
Sep 04 16:02:51 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:51 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d52e7694-5b00-4e99-9e90-fcd13e477904 tempest-VolumesListTestJSON-632300541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6" returned: 0 in 0.266s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d52e7694-5b00-4e99-9e90-fcd13e477904 tempest-VolumesListTestJSON-632300541 None] Lock "cinder-quobyte-dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6" released by "delete_volume" :: held 0.724s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:02:52 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-d52e7694-5b00-4e99-9e90-fcd13e477904 tempest-VolumesListTestJSON-632300541 None] Created reservations ['704fdc65-f8a7-4b38-8e1d-3b3a34cd4df6', '060d1e96-5c9c-4ed1-a0b7-02527dfc1df8', '6b7f7ef4-d2b1-47a5-a0fa-c9da73e92286', '84759772-9de1-4864-ab6f-dbde563c2306'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:02:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d52e7694-5b00-4e99-9e90-fcd13e477904 tempest-VolumesListTestJSON-632300541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:02:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d52e7694-5b00-4e99-9e90-fcd13e477904 tempest-VolumesListTestJSON-632300541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:02:52 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d52e7694-5b00-4e99-9e90-fcd13e477904 tempest-VolumesListTestJSON-632300541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:02:52 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d52e7694-5b00-4e99-9e90-fcd13e477904 tempest-VolumesListTestJSON-632300541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:02:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d52e7694-5b00-4e99-9e90-fcd13e477904 tempest-VolumesListTestJSON-632300541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:02:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d52e7694-5b00-4e99-9e90-fcd13e477904 tempest-VolumesListTestJSON-632300541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:52 devstack sudo[102758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:02:52 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:52 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d52e7694-5b00-4e99-9e90-fcd13e477904 tempest-VolumesListTestJSON-632300541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.264s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:52 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-d52e7694-5b00-4e99-9e90-fcd13e477904 tempest-VolumesListTestJSON-632300541 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:02:52 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-d52e7694-5b00-4e99-9e90-fcd13e477904 tempest-VolumesListTestJSON-632300541 None] Deleted volume successfully.
Sep 04 16:02:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d52e7694-5b00-4e99-9e90-fcd13e477904 tempest-VolumesListTestJSON-632300541 None] Lock "cinder-dc0a8445-dd7d-4ab1-a72c-fbd01e3671e6-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:02:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8a6b2f91-9c1d-4bc2-b541-a268bb15afb7 tempest-VolumesListTestJSON-632300541 None] Acquiring lock "cinder-717dba2a-a3bf-4d0e-b663-c1d0c363b890-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:02:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8a6b2f91-9c1d-4bc2-b541-a268bb15afb7 tempest-VolumesListTestJSON-632300541 None] Lock "cinder-717dba2a-a3bf-4d0e-b663-c1d0c363b890-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:02:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8a6b2f91-9c1d-4bc2-b541-a268bb15afb7 tempest-VolumesListTestJSON-632300541 None] Acquiring lock "cinder-quobyte-717dba2a-a3bf-4d0e-b663-c1d0c363b890" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:02:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8a6b2f91-9c1d-4bc2-b541-a268bb15afb7 tempest-VolumesListTestJSON-632300541 None] Lock "cinder-quobyte-717dba2a-a3bf-4d0e-b663-c1d0c363b890" acquired by "delete_volume" :: waited 0.014s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:02:52 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f208a7b9-1442-444a-86a1-8967057d8577]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:02:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8a6b2f91-9c1d-4bc2-b541-a268bb15afb7 tempest-VolumesListTestJSON-632300541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-717dba2a-a3bf-4d0e-b663-c1d0c363b890 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:52 devstack sudo[102761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-717dba2a-a3bf-4d0e-b663-c1d0c363b890
Sep 04 16:02:52 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:52 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8a6b2f91-9c1d-4bc2-b541-a268bb15afb7 tempest-VolumesListTestJSON-632300541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-717dba2a-a3bf-4d0e-b663-c1d0c363b890" returned: 0 in 0.476s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8a6b2f91-9c1d-4bc2-b541-a268bb15afb7 tempest-VolumesListTestJSON-632300541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-717dba2a-a3bf-4d0e-b663-c1d0c363b890 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:53 devstack sudo[102766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-717dba2a-a3bf-4d0e-b663-c1d0c363b890
Sep 04 16:02:53 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:53 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8a6b2f91-9c1d-4bc2-b541-a268bb15afb7 tempest-VolumesListTestJSON-632300541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-717dba2a-a3bf-4d0e-b663-c1d0c363b890" returned: 0 in 0.256s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8a6b2f91-9c1d-4bc2-b541-a268bb15afb7 tempest-VolumesListTestJSON-632300541 None] Lock "cinder-quobyte-717dba2a-a3bf-4d0e-b663-c1d0c363b890" released by "delete_volume" :: held 0.777s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:02:53 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-8a6b2f91-9c1d-4bc2-b541-a268bb15afb7 tempest-VolumesListTestJSON-632300541 None] Created reservations ['86a5192a-4bbd-408b-8ce3-7c50e343ee5d', '4f4a378f-34cb-41b7-81fc-b8fd91d188a8', '330e5876-c00e-46a1-bb29-f99a96fe62e4', '4e217e71-602d-4993-b683-da02d1515fc5'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:02:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-8a6b2f91-9c1d-4bc2-b541-a268bb15afb7 tempest-VolumesListTestJSON-632300541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:02:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-8a6b2f91-9c1d-4bc2-b541-a268bb15afb7 tempest-VolumesListTestJSON-632300541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:02:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-8a6b2f91-9c1d-4bc2-b541-a268bb15afb7 tempest-VolumesListTestJSON-632300541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:02:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-8a6b2f91-9c1d-4bc2-b541-a268bb15afb7 tempest-VolumesListTestJSON-632300541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:02:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-8a6b2f91-9c1d-4bc2-b541-a268bb15afb7 tempest-VolumesListTestJSON-632300541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:02:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8a6b2f91-9c1d-4bc2-b541-a268bb15afb7 tempest-VolumesListTestJSON-632300541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:53 devstack sudo[102769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:02:53 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:53 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8a6b2f91-9c1d-4bc2-b541-a268bb15afb7 tempest-VolumesListTestJSON-632300541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.301s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:53 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-8a6b2f91-9c1d-4bc2-b541-a268bb15afb7 tempest-VolumesListTestJSON-632300541 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:02:53 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-8a6b2f91-9c1d-4bc2-b541-a268bb15afb7 tempest-VolumesListTestJSON-632300541 None] Deleted volume successfully.
Sep 04 16:02:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5e2f2dcc-4b48-4f83-8705-0caf773cfd8a tempest-VolumesListTestJSON-632300541 None] Acquiring lock "cinder-94d9df09-0eab-4d1a-8618-90a7aec16708-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:02:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8a6b2f91-9c1d-4bc2-b541-a268bb15afb7 tempest-VolumesListTestJSON-632300541 None] Lock "cinder-717dba2a-a3bf-4d0e-b663-c1d0c363b890-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:02:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5e2f2dcc-4b48-4f83-8705-0caf773cfd8a tempest-VolumesListTestJSON-632300541 None] Lock "cinder-94d9df09-0eab-4d1a-8618-90a7aec16708-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:02:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5e2f2dcc-4b48-4f83-8705-0caf773cfd8a tempest-VolumesListTestJSON-632300541 None] Acquiring lock "cinder-quobyte-94d9df09-0eab-4d1a-8618-90a7aec16708" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:02:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5e2f2dcc-4b48-4f83-8705-0caf773cfd8a tempest-VolumesListTestJSON-632300541 None] Lock "cinder-quobyte-94d9df09-0eab-4d1a-8618-90a7aec16708" acquired by "delete_volume" :: waited 0.016s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:02:53 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10a3c77-d308-4ac4-9888-f7252e6661b5]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:02:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5e2f2dcc-4b48-4f83-8705-0caf773cfd8a tempest-VolumesListTestJSON-632300541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-94d9df09-0eab-4d1a-8618-90a7aec16708 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:54 devstack sudo[102772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-94d9df09-0eab-4d1a-8618-90a7aec16708
Sep 04 16:02:54 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:54 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5e2f2dcc-4b48-4f83-8705-0caf773cfd8a tempest-VolumesListTestJSON-632300541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-94d9df09-0eab-4d1a-8618-90a7aec16708" returned: 0 in 0.430s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5e2f2dcc-4b48-4f83-8705-0caf773cfd8a tempest-VolumesListTestJSON-632300541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-94d9df09-0eab-4d1a-8618-90a7aec16708 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:54 devstack sudo[102777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-94d9df09-0eab-4d1a-8618-90a7aec16708
Sep 04 16:02:54 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:54 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5e2f2dcc-4b48-4f83-8705-0caf773cfd8a tempest-VolumesListTestJSON-632300541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-94d9df09-0eab-4d1a-8618-90a7aec16708" returned: 0 in 0.330s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5e2f2dcc-4b48-4f83-8705-0caf773cfd8a tempest-VolumesListTestJSON-632300541 None] Lock "cinder-quobyte-94d9df09-0eab-4d1a-8618-90a7aec16708" released by "delete_volume" :: held 0.810s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:02:54 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-5e2f2dcc-4b48-4f83-8705-0caf773cfd8a tempest-VolumesListTestJSON-632300541 None] Created reservations ['e8ef0ed6-53cb-4ad4-bb98-f8453b2d2d3f', '22b2feb8-d6a1-4515-b8cb-2512786f7dde', '72515b82-4c27-4f48-8e45-ef7acb0428f3', 'f5ed39d1-2397-4534-9c6f-08977d8413ee'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:02:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5e2f2dcc-4b48-4f83-8705-0caf773cfd8a tempest-VolumesListTestJSON-632300541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:02:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5e2f2dcc-4b48-4f83-8705-0caf773cfd8a tempest-VolumesListTestJSON-632300541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:02:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5e2f2dcc-4b48-4f83-8705-0caf773cfd8a tempest-VolumesListTestJSON-632300541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:02:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5e2f2dcc-4b48-4f83-8705-0caf773cfd8a tempest-VolumesListTestJSON-632300541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:02:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5e2f2dcc-4b48-4f83-8705-0caf773cfd8a tempest-VolumesListTestJSON-632300541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:02:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5e2f2dcc-4b48-4f83-8705-0caf773cfd8a tempest-VolumesListTestJSON-632300541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:54 devstack sudo[102781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:02:54 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:55 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5e2f2dcc-4b48-4f83-8705-0caf773cfd8a tempest-VolumesListTestJSON-632300541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.372s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:55 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-5e2f2dcc-4b48-4f83-8705-0caf773cfd8a tempest-VolumesListTestJSON-632300541 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:02:55 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-5e2f2dcc-4b48-4f83-8705-0caf773cfd8a tempest-VolumesListTestJSON-632300541 None] Deleted volume successfully.
Sep 04 16:02:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5e2f2dcc-4b48-4f83-8705-0caf773cfd8a tempest-VolumesListTestJSON-632300541 None] Lock "cinder-94d9df09-0eab-4d1a-8618-90a7aec16708-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:02:58 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:02:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Flow 'volume_create_manager' (fdb0eab6-6d14-4905-9a09-891b4959d0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:02:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4822b65-be28-43c1-ba90-17a4dcfb4efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4822b65-be28-43c1-ba90-17a4dcfb4efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1163871049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94ef046-c378-4179-b8b9-7af65ee71499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0cf1372664248b2a494c09eea5383ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:58Z,use_quota=True,user_id='3781bdaaec20463197ee525b0b641fe1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38915d00-4364-4348-a6a2-b84484976b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38915d00-4364-4348-a6a2-b84484976b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51a4ad2-6e09-4392-8ca6-65f101e0a202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51a4ad2-6e09-4392-8ca6-65f101e0a202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c94ef046-c378-4179-b8b9-7af65ee71499', 'volume_name': 'volume-c94ef046-c378-4179-b8b9-7af65ee71499', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8126da-054c-404e-9821-b6c3f49e0ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8126da-054c-404e-9821-b6c3f49e0ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ff7fd4-b580-4aca-8d8b-94056fc8a6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:58 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Volume c94ef046-c378-4179-b8b9-7af65ee71499: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c94ef046-c378-4179-b8b9-7af65ee71499', 'volume_size': 1}
Sep 04 16:02:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:02:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:02:58 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1163871049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94ef046-c378-4179-b8b9-7af65ee71499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0cf1372664248b2a494c09eea5383ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:58Z,use_quota=True,user_id='3781bdaaec20463197ee525b0b641fe1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:02:58 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Creating volume c94ef046-c378-4179-b8b9-7af65ee71499 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:02:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:02:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:02:58 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:02:58 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:02:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:02:58 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:02:58 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:02:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c94ef046-c378-4179-b8b9-7af65ee71499 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:58 devstack sudo[102784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c94ef046-c378-4179-b8b9-7af65ee71499 1073741824
Sep 04 16:02:58 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:58 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c94ef046-c378-4179-b8b9-7af65ee71499 1073741824" returned: 0 in 0.450s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c94ef046-c378-4179-b8b9-7af65ee71499 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:02:58 devstack sudo[102790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c94ef046-c378-4179-b8b9-7af65ee71499
Sep 04 16:02:58 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:02:59 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root
Sep 04 16:02:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c94ef046-c378-4179-b8b9-7af65ee71499" returned: 0 in 0.309s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:02:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:02:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:02:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ff7fd4-b580-4aca-8d8b-94056fc8a6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c94ef046-c378-4179-b8b9-7af65ee71499', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112b9d27-9cc7-43f6-92e2-2db58e8bbc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:02:59 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Volume volume-c94ef046-c378-4179-b8b9-7af65ee71499 (c94ef046-c378-4179-b8b9-7af65ee71499): created successfully
Sep 04 16:02:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112b9d27-9cc7-43f6-92e2-2db58e8bbc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:02:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Flow 'volume_create_manager' (fdb0eab6-6d14-4905-9a09-891b4959d0c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:02:59 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-69d5b2c1-8ae6-4e10-8b94-72155176f755 tempest-VolumesNegativeTest-419549540 None] Created volume successfully.
Sep 04 16:03:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-77c23689-b052-4698-910d-fdebe602ce32 req-1d1b229f-b92e-4c02-8460-2b867ac48f21 tempest-TestStampPattern-391961132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:03:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-77c23689-b052-4698-910d-fdebe602ce32 req-1d1b229f-b92e-4c02-8460-2b867ac48f21 tempest-TestStampPattern-391961132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:03:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-77c23689-b052-4698-910d-fdebe602ce32 req-1d1b229f-b92e-4c02-8460-2b867ac48f21 tempest-TestStampPattern-391961132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:03:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-77c23689-b052-4698-910d-fdebe602ce32 req-1d1b229f-b92e-4c02-8460-2b867ac48f21 tempest-TestStampPattern-391961132 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236', 'name': 'volume-7effc614-7270-4918-b415-95a8238c156e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18270f94-2ef7-49dc-927a-fe22a5acc68f', 'enforce_multipath': True} {{(pid=87504) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 16:03:03 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-77c23689-b052-4698-910d-fdebe602ce32 req-1d1b229f-b92e-4c02-8460-2b867ac48f21 tempest-TestStampPattern-391961132 None] attachment_update completed successfully.
Sep 04 16:03:09 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-56819ef6-2c81-4014-bb6c-6e20f7dd6e79 req-07465b94-6b06-4900-be41-7fe23bfc0e37 tempest-TestStampPattern-391961132 None] Terminate volume connection completed successfully.
Sep 04 16:03:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-56819ef6-2c81-4014-bb6c-6e20f7dd6e79 req-07465b94-6b06-4900-be41-7fe23bfc0e37 tempest-TestStampPattern-391961132 None] Deleting attachment 18270f94-2ef7-49dc-927a-fe22a5acc68f. {{(pid=87504) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 16:03:10 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:03:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Flow 'volume_create_manager' (8ca02f1b-5bb4-4ce0-a70b-c58a1e590a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:03:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47dc4b7e-28dd-4a0c-a22a-ee663306b598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:03:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47dc4b7e-28dd-4a0c-a22a-ee663306b598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-337265073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba75d1c8-37db-4a1d-817f-9aa6fa964683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d0daa07258145119c96b84119e20210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:03:10Z,use_quota=True,user_id='9f92fb7ef00141ef8d682eddfad2b238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:03:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3546e0fc-25fd-41bc-9db6-9b752333f0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:03:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3546e0fc-25fd-41bc-9db6-9b752333f0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:03:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a937a62d-6caa-4c36-b86a-91a1406ed0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:03:10 devstack cinder-volume[87504]: DEBUG cinder.image.glance [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Creating Keystone auth plugin from conf {{(pid=87504) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 04 16:03:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-69310c8b-e1c3-4fdc-8d06-208eed6ae57c tempest-TestStampPattern-391961132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:03:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-69310c8b-e1c3-4fdc-8d06-208eed6ae57c tempest-TestStampPattern-391961132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:03:10 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-69310c8b-e1c3-4fdc-8d06-208eed6ae57c tempest-TestStampPattern-391961132 None] Creating offline snapshot ac8cb290-dbb1-4786-891a-a3d870e93bda of volume 7effc614-7270-4918-b415-95a8238c156e {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 16:03:10 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc498b4d-36c1-40fb-8eeb-ed04d64ef318]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:03:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-69310c8b-e1c3-4fdc-8d06-208eed6ae57c tempest-TestStampPattern-391961132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:03:10 devstack sudo[103362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e
Sep 04 16:03:10 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:03:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a937a62d-6caa-4c36-b86a-91a1406ed0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ba75d1c8-37db-4a1d-817f-9aa6fa964683', 'volume_name': 'volume-ba75d1c8-37db-4a1d-817f-9aa6fa964683', 'volume_size': 1, 'image_id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f6dbd3908a2d48468b7f486df9705903', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9488c80e-bb64-48e5-b1fb-9998fd167822/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1a2d154f0>}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:03:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c658d64-7776-496a-9f54-b424d33f4db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:03:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c658d64-7776-496a-9f54-b424d33f4db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:03:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc94b76-d1e7-479e-811e-3e91d60c0dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:03:11 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Volume ba75d1c8-37db-4a1d-817f-9aa6fa964683: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ba75d1c8-37db-4a1d-817f-9aa6fa964683', 'volume_size': 1, 'image_id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f6dbd3908a2d48468b7f486df9705903', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9488c80e-bb64-48e5-b1fb-9998fd167822/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1a2d154f0>}
Sep 04 16:03:11 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Trying to clone ba75d1c8-37db-4a1d-817f-9aa6fa964683 from image 9488c80e-bb64-48e5-b1fb-9998fd167822 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}]). {{(pid=87504) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 04 16:03:11 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root
Sep 04 16:03:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-69310c8b-e1c3-4fdc-8d06-208eed6ae57c tempest-TestStampPattern-391961132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e" returned: 0 in 0.543s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:03:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-69310c8b-e1c3-4fdc-8d06-208eed6ae57c tempest-TestStampPattern-391961132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.ac8cb290-dbb1-4786-891a-a3d870e93bda 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:03:11 devstack sudo[103387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.ac8cb290-dbb1-4786-891a-a3d870e93bda 1G
Sep 04 16:03:11 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:03:11 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_956ybnkhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 04 16:03:11 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Image download 20.69 MB at 20.69 MB/s
Sep 04 16:03:11 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[690ce538-609c-4195-8e5e-889532f0543a]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:03:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_956ybnkhdevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:03:11 devstack sudo[103390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_956ybnkhdevstack@QuobyteHD
Sep 04 16:03:11 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:03:11 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root
Sep 04 16:03:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-69310c8b-e1c3-4fdc-8d06-208eed6ae57c tempest-TestStampPattern-391961132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.ac8cb290-dbb1-4786-891a-a3d870e93bda 1G" returned: 0 in 0.818s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:03:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-69310c8b-e1c3-4fdc-8d06-208eed6ae57c tempest-TestStampPattern-391961132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7effc614-7270-4918-b415-95a8238c156e -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.ac8cb290-dbb1-4786-891a-a3d870e93bda {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:03:12 devstack sudo[103398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7effc614-7270-4918-b415-95a8238c156e -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.ac8cb290-dbb1-4786-891a-a3d870e93bda
Sep 04 16:03:12 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:03:12 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root
Sep 04 16:03:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_956ybnkhdevstack@QuobyteHD" returned: 0 in 0.560s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:03:12 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Temporary image 9488c80e-bb64-48e5-b1fb-9998fd167822 is fetched for user 9f92fb7ef00141ef8d682eddfad2b238. {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 04 16:03:12 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a19140-7a5c-45da-8754-cde8ac5338c2]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:03:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_956ybnkhdevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:03:12 devstack sudo[103404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_956ybnkhdevstack@QuobyteHD
Sep 04 16:03:12 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:03:12 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root
Sep 04 16:03:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-69310c8b-e1c3-4fdc-8d06-208eed6ae57c tempest-TestStampPattern-391961132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7effc614-7270-4918-b415-95a8238c156e -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.ac8cb290-dbb1-4786-891a-a3d870e93bda" returned: 0 in 0.327s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:03:12 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-69310c8b-e1c3-4fdc-8d06-208eed6ae57c tempest-TestStampPattern-391961132 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.ac8cb290-dbb1-4786-891a-a3d870e93bda is being set with open permissions: ugo+rw
Sep 04 16:03:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-69310c8b-e1c3-4fdc-8d06-208eed6ae57c tempest-TestStampPattern-391961132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.ac8cb290-dbb1-4786-891a-a3d870e93bda {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:03:12 devstack sudo[103409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.ac8cb290-dbb1-4786-891a-a3d870e93bda
Sep 04 16:03:12 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:03:12 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root
Sep 04 16:03:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_956ybnkhdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:03:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:03:12 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root
Sep 04 16:03:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-69310c8b-e1c3-4fdc-8d06-208eed6ae57c tempest-TestStampPattern-391961132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.ac8cb290-dbb1-4786-891a-a3d870e93bda" returned: 0 in 0.312s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:03:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-69310c8b-e1c3-4fdc-8d06-208eed6ae57c tempest-TestStampPattern-391961132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:03:12 devstack sudo[103415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.info
Sep 04 16:03:12 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:03:12 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root
Sep 04 16:03:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-69310c8b-e1c3-4fdc-8d06-208eed6ae57c tempest-TestStampPattern-391961132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.info" returned: 0 in 0.242s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:03:12 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-69310c8b-e1c3-4fdc-8d06-208eed6ae57c tempest-TestStampPattern-391961132 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.info is being set with open permissions: ugo+rw
Sep 04 16:03:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-69310c8b-e1c3-4fdc-8d06-208eed6ae57c tempest-TestStampPattern-391961132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:03:12 devstack sudo[103418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.info
Sep 04 16:03:12 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:03:13 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root
Sep 04 16:03:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-69310c8b-e1c3-4fdc-8d06-208eed6ae57c tempest-TestStampPattern-391961132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.info" returned: 0 in 0.260s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:03:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-69310c8b-e1c3-4fdc-8d06-208eed6ae57c tempest-TestStampPattern-391961132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.605s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:03:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.653s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:03:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-337265073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba75d1c8-37db-4a1d-817f-9aa6fa964683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d0daa07258145119c96b84119e20210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:03:10Z,use_quota=True,user_id='9f92fb7ef00141ef8d682eddfad2b238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:03:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Creating volume ba75d1c8-37db-4a1d-817f-9aa6fa964683 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:03:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:03:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:03:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:03:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:03:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:03:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:03:13 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:03:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ba75d1c8-37db-4a1d-817f-9aa6fa964683 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:03:13 devstack sudo[103421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ba75d1c8-37db-4a1d-817f-9aa6fa964683 1073741824
Sep 04 16:03:13 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:03:13 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-69310c8b-e1c3-4fdc-8d06-208eed6ae57c tempest-TestStampPattern-391961132 None] Create snapshot completed successfully
Sep 04 16:03:13 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root
Sep 04 16:03:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ba75d1c8-37db-4a1d-817f-9aa6fa964683 1073741824" returned: 0 in 0.490s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:03:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ba75d1c8-37db-4a1d-817f-9aa6fa964683 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:03:13 devstack sudo[103427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ba75d1c8-37db-4a1d-817f-9aa6fa964683
Sep 04 16:03:13 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:03:14 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root
Sep 04 16:03:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ba75d1c8-37db-4a1d-817f-9aa6fa964683" returned: 0 in 0.302s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:03:14 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:03:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:03:14 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Attempting download of 9488c80e-bb64-48e5-b1fb-9998fd167822 ((None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}])) to volume ba75d1c8-37db-4a1d-817f-9aa6fa964683. {{(pid=87504) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 04 16:03:14 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba6fc50-c3fa-44a7-ba14-1170d990e496]: (4, 'raw') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:03:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_j0kujufh {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:03:14 devstack sudo[103431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_j0kujufh
Sep 04 16:03:14 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:03:14 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root
Sep 04 16:03:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_j0kujufh" returned: 0 in 0.395s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:03:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_j0kujufh {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:03:15 devstack sudo[103435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_j0kujufh
Sep 04 16:03:15 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:03:15 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root
Sep 04 16:03:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_j0kujufh" returned: 1 in 0.366s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:03:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9488c80e-bb64-48e5-b1fb-9998fd167822_j0kujufh' failed. Not Retrying. {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 16:03:15 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[035b75f5-277c-4f84-a454-f609d4e5f18f]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:03:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_956ybnkhdevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:03:15 devstack sudo[103443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_956ybnkhdevstack@QuobyteHD
Sep 04 16:03:15 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:03:15 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root
Sep 04 16:03:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_956ybnkhdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:03:15 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] 9488c80e-bb64-48e5-b1fb-9998fd167822 was qcow2, converting to qcow2 {{(pid=87504) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 04 16:03:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_956ybnkhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ba75d1c8-37db-4a1d-817f-9aa6fa964683 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:03:15 devstack sudo[103463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_956ybnkhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ba75d1c8-37db-4a1d-817f-9aa6fa964683
Sep 04 16:03:15 devstack sudo[103463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:03:17 devstack sudo[103463]: pam_unix(sudo:session): session closed for user root
Sep 04 16:03:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_956ybnkhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ba75d1c8-37db-4a1d-817f-9aa6fa964683" returned: 0 in 1.999s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:03:17 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9488c80e-bb64-48e5-b1fb-9998fd167822_956ybnkhdevstack@QuobyteHD, size 112.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ba75d1c8-37db-4a1d-817f-9aa6fa964683 {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 16:03:17 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Converted 112.00 MB image at 55.98 MB/s
Sep 04 16:03:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ba75d1c8-37db-4a1d-817f-9aa6fa964683 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:03:17 devstack sudo[103483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ba75d1c8-37db-4a1d-817f-9aa6fa964683 1G
Sep 04 16:03:17 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:03:18 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root
Sep 04 16:03:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ba75d1c8-37db-4a1d-817f-9aa6fa964683 1G" returned: 0 in 0.369s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:03:18 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Downloaded image 9488c80e-bb64-48e5-b1fb-9998fd167822 ((None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}])) to volume ba75d1c8-37db-4a1d-817f-9aa6fa964683 successfully. {{(pid=87504) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 04 16:03:18 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Temporary image 9488c80e-bb64-48e5-b1fb-9998fd167822 for user 9f92fb7ef00141ef8d682eddfad2b238 is deleted. {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 04 16:03:18 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Marking volume ba75d1c8-37db-4a1d-817f-9aa6fa964683 as bootable. {{(pid=87504) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 04 16:03:18 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Copying metadata from image 9488c80e-bb64-48e5-b1fb-9998fd167822 to ba75d1c8-37db-4a1d-817f-9aa6fa964683. {{(pid=87504) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 04 16:03:18 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Creating volume glance metadata for volume ba75d1c8-37db-4a1d-817f-9aa6fa964683 backed by image 9488c80e-bb64-48e5-b1fb-9998fd167822 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87504) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 04 16:03:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc94b76-d1e7-479e-811e-3e91d60c0dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba75d1c8-37db-4a1d-817f-9aa6fa964683', 'volume_size': 1, 'image_id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9488c80e-bb64-48e5-b1fb-9998fd167822', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f6dbd3908a2d48468b7f486df9705903', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9488c80e-bb64-48e5-b1fb-9998fd167822', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9488c80e-bb64-48e5-b1fb-9998fd167822/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1a2d154f0>}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:03:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d177b3-137a-4ca4-8e79-aaf56a840867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:03:18 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Volume volume-ba75d1c8-37db-4a1d-817f-9aa6fa964683 (ba75d1c8-37db-4a1d-817f-9aa6fa964683): created successfully
Sep 04 16:03:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d177b3-137a-4ca4-8e79-aaf56a840867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:03:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Flow 'volume_create_manager' (8ca02f1b-5bb4-4ce0-a70b-c58a1e590a20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:03:18 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-99fbf79d-1c04-4a22-806f-6e856b3c5d19 tempest-TestShelveInstance-1989432834 None] Created volume successfully.
Sep 04 16:03:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-eb68bdf6-cce5-4cfb-87d8-6453e56cfa0f tempest-VolumesNegativeTest-419549540 None] Acquiring lock "cinder-c94ef046-c378-4179-b8b9-7af65ee71499-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:03:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-eb68bdf6-cce5-4cfb-87d8-6453e56cfa0f tempest-VolumesNegativeTest-419549540 None] Lock "cinder-c94ef046-c378-4179-b8b9-7af65ee71499-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:03:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-eb68bdf6-cce5-4cfb-87d8-6453e56cfa0f tempest-VolumesNegativeTest-419549540 None] Acquiring lock "cinder-quobyte-c94ef046-c378-4179-b8b9-7af65ee71499" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:03:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-eb68bdf6-cce5-4cfb-87d8-6453e56cfa0f tempest-VolumesNegativeTest-419549540 None] Lock "cinder-quobyte-c94ef046-c378-4179-b8b9-7af65ee71499" acquired by "delete_volume" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:03:19 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[24501a6e-3910-463b-8580-aa81eb569ab2]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:03:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-eb68bdf6-cce5-4cfb-87d8-6453e56cfa0f tempest-VolumesNegativeTest-419549540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c94ef046-c378-4179-b8b9-7af65ee71499 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:03:20 devstack sudo[103495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c94ef046-c378-4179-b8b9-7af65ee71499
Sep 04 16:03:20 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:03:20 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root
Sep 04 16:03:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-eb68bdf6-cce5-4cfb-87d8-6453e56cfa0f tempest-VolumesNegativeTest-419549540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c94ef046-c378-4179-b8b9-7af65ee71499" returned: 0 in 0.416s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:03:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-eb68bdf6-cce5-4cfb-87d8-6453e56cfa0f tempest-VolumesNegativeTest-419549540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c94ef046-c378-4179-b8b9-7af65ee71499 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:03:20 devstack sudo[103503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c94ef046-c378-4179-b8b9-7af65ee71499
Sep 04 16:03:20 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:03:20 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root
Sep 04 16:03:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-eb68bdf6-cce5-4cfb-87d8-6453e56cfa0f tempest-VolumesNegativeTest-419549540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c94ef046-c378-4179-b8b9-7af65ee71499" returned: 0 in 0.278s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:03:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-eb68bdf6-cce5-4cfb-87d8-6453e56cfa0f tempest-VolumesNegativeTest-419549540 None] Lock "cinder-quobyte-c94ef046-c378-4179-b8b9-7af65ee71499" released by "delete_volume" :: held 0.744s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:03:20 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-eb68bdf6-cce5-4cfb-87d8-6453e56cfa0f tempest-VolumesNegativeTest-419549540 None] Created reservations ['61d8b7f2-4687-489d-b3c3-aecbb577ee56', '67608a3e-b8fe-4593-a7eb-7dca8e5fa708', 'dad0d865-4cf3-4bd7-b0af-48213403f1d2', '51094572-0b05-4f22-a0fe-e1f5b2020f2a'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:03:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-eb68bdf6-cce5-4cfb-87d8-6453e56cfa0f tempest-VolumesNegativeTest-419549540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:03:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-eb68bdf6-cce5-4cfb-87d8-6453e56cfa0f tempest-VolumesNegativeTest-419549540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:03:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-eb68bdf6-cce5-4cfb-87d8-6453e56cfa0f tempest-VolumesNegativeTest-419549540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:03:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-eb68bdf6-cce5-4cfb-87d8-6453e56cfa0f tempest-VolumesNegativeTest-419549540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:03:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-eb68bdf6-cce5-4cfb-87d8-6453e56cfa0f tempest-VolumesNegativeTest-419549540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:03:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-eb68bdf6-cce5-4cfb-87d8-6453e56cfa0f tempest-VolumesNegativeTest-419549540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:03:20 devstack sudo[103506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:03:20 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:03:21 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Flow 'volume_create_manager' (b138c114-c9c8-45ce-b72b-2211d80bb81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (317767ea-eccf-4696-a1a1-8d26e62e53bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-eb68bdf6-cce5-4cfb-87d8-6453e56cfa0f tempest-VolumesNegativeTest-419549540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.463s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-eb68bdf6-cce5-4cfb-87d8-6453e56cfa0f tempest-VolumesNegativeTest-419549540 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:03:21 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-eb68bdf6-cce5-4cfb-87d8-6453e56cfa0f tempest-VolumesNegativeTest-419549540 None] Deleted volume successfully.
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (317767ea-eccf-4696-a1a1-8d26e62e53bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1925925488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca1a9d97-ac63-4b02-a99e-db939a2e3ef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f914e0bf1d84cb6b1172a1379b403d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ac8cb290-dbb1-4786-891a-a3d870e93bda,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:03:21Z,use_quota=True,user_id='9ba6732a6c1c46ff9a242c69db1890c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da932ea-5f3c-40ef-9cb7-81b291230812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da932ea-5f3c-40ef-9cb7-81b291230812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2913111c-5e0e-4088-97be-09727ff523cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2913111c-5e0e-4088-97be-09727ff523cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ca1a9d97-ac63-4b02-a99e-db939a2e3ef3', 'volume_name': 'volume-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3', 'volume_size': 1, 'snapshot_id': 'ac8cb290-dbb1-4786-891a-a3d870e93bda'}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9208772d-e108-42b6-8477-34fbfd2659b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9208772d-e108-42b6-8477-34fbfd2659b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (884b71af-d969-43ec-b2f5-1b0e111ee963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:03:21 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Volume ca1a9d97-ac63-4b02-a99e-db939a2e3ef3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3', 'volume_size': 1, 'snapshot_id': 'ac8cb290-dbb1-4786-891a-a3d870e93bda'}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Acquiring lock "cinder-quobyte-ac8cb290-dbb1-4786-891a-a3d870e93bda-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3" by "_create_volume_from_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-eb68bdf6-cce5-4cfb-87d8-6453e56cfa0f tempest-VolumesNegativeTest-419549540 None] Lock "cinder-c94ef046-c378-4179-b8b9-7af65ee71499-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Lock "cinder-quobyte-ac8cb290-dbb1-4786-891a-a3d870e93bda-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Creating volume ca1a9d97-ac63-4b02-a99e-db939a2e3ef3 from snapshot ac8cb290-dbb1-4786-891a-a3d870e93bda {{(pid=87504) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Acquiring lock "cinder-quobyte-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3" by "_copy_volume_from_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Lock "cinder-quobyte-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] snapshot: ac8cb290-dbb1-4786-891a-a3d870e93bda, volume: ca1a9d97-ac63-4b02-a99e-db939a2e3ef3,  {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed921d00-2f9a-46c0-b0e5-57c15090e9d4]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:03:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.ac8cb290-dbb1-4786-891a-a3d870e93bda {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:03:21 devstack sudo[103509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.ac8cb290-dbb1-4786-891a-a3d870e93bda
Sep 04 16:03:21 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:03:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-5e74f0a0-5b69-476a-bffd-24b6888349a5 req-3a9decfc-1a97-4ea3-a1cc-6a53719fbd04 tempest-TestShelveInstance-1989432834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:03:22 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root
Sep 04 16:03:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.ac8cb290-dbb1-4786-891a-a3d870e93bda" returned: 0 in 0.518s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:03:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7effc614-7270-4918-b415-95a8238c156e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:03:22 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2548cb26-9009-4b0b-950e-8eff86e31e91]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:03:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:03:22 devstack sudo[103525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e
Sep 04 16:03:22 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:03:22 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root
Sep 04 16:03:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e" returned: 0 in 0.421s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:03:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 04 16:03:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Creating direct copy from snapshot {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 04 16:03:22 devstack cinder-volume[87504]: DEBUG cinder.utils [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Path /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3 not found in is_blk_device check {{(pid=87504) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 04 16:03:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:03:22 devstack sudo[103530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3
Sep 04 16:03:22 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:03:29 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root
Sep 04 16:03:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3" returned: 0 in 6.990s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:03:29 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e, size 1024.00 MB, duration 6.99 sec, destination /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3 {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 16:03:29 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Converted 1024.00 MB image at 146.47 MB/s
Sep 04 16:03:29 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3 is being set with open permissions: ugo+rw
Sep 04 16:03:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:03:29 devstack sudo[103548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3
Sep 04 16:03:29 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:03:29 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root
Sep 04 16:03:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3" returned: 0 in 0.344s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:03:29 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Lock "cinder-quobyte-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3" released by "_copy_volume_from_snapshot" :: held 8.395s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:03:30 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Lock "cinder-quobyte-ac8cb290-dbb1-4786-891a-a3d870e93bda-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3" released by "_create_volume_from_snapshot" :: held 8.598s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:03:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.626s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:03:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-5e74f0a0-5b69-476a-bffd-24b6888349a5 req-3a9decfc-1a97-4ea3-a1cc-6a53719fbd04 tempest-TestShelveInstance-1989432834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.018s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:03:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-5e74f0a0-5b69-476a-bffd-24b6888349a5 req-3a9decfc-1a97-4ea3-a1cc-6a53719fbd04 tempest-TestShelveInstance-1989432834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:03:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (884b71af-d969-43ec-b2f5-1b0e111ee963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3', 'volume_size': 1, 'snapshot_id': 'ac8cb290-dbb1-4786-891a-a3d870e93bda'}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:03:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7346ec3c-1072-40a0-b3a8-4b20135152b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:03:30 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Volume volume-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3 (ca1a9d97-ac63-4b02-a99e-db939a2e3ef3): created successfully
Sep 04 16:03:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7346ec3c-1072-40a0-b3a8-4b20135152b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:03:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Flow 'volume_create_manager' (b138c114-c9c8-45ce-b72b-2211d80bb81c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:03:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-5e74f0a0-5b69-476a-bffd-24b6888349a5 req-3a9decfc-1a97-4ea3-a1cc-6a53719fbd04 tempest-TestShelveInstance-1989432834 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236', 'name': 'volume-ba75d1c8-37db-4a1d-817f-9aa6fa964683', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a17931c-0da9-4099-89be-4d34aac1f024', 'enforce_multipath': True} {{(pid=87504) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 16:03:30 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-97f2fd19-b6a6-4bea-b668-03cbdf91616e tempest-TestStampPattern-391961132 None] Created volume successfully.
Sep 04 16:03:30 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-5e74f0a0-5b69-476a-bffd-24b6888349a5 req-3a9decfc-1a97-4ea3-a1cc-6a53719fbd04 tempest-TestShelveInstance-1989432834 None] attachment_update completed successfully.
Sep 04 16:03:40 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:UPDATE=56,cinder:SELECT=58,cinder:DELETE=6,cinder:INSERT=19 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:03:40 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=59,cinder:UPDATE=56,cinder:INSERT=17,cinder:DELETE=5 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:03:48 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 16:03:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:03:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:03:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:03:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:03:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:03:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:03:48 devstack sudo[104084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:03:48 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:03:49 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root
Sep 04 16:03:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.440s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:03:49 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:03:49 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager._thread_info {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 16:03:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread count: 28 {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 16:03:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread info: [<_MainThread(MainThread, started 131673838448768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131673724603200)>, <Thread(Thread-3 (stat_writer), started daemon 131673723495936)>, <Thread(Rabbit-heartbeat, started daemon 131673723764800)>, <Thread(Thread-5 (_runner), started daemon 131673722269632)>, <Thread(Thread-7 (_runner), started daemon 131673722322112)>, <Thread(fd_logger, started daemon 131673722585024)>, <Thread(privsep_reader, started daemon 131673721593984)>, <Thread(tpool_thread_0, started daemon 131673714706112)>, <Thread(tpool_thread_1, started daemon 131673706313408)>, <Thread(tpool_thread_2, started daemon 131673697920704)>, <Thread(tpool_thread_3, started daemon 131673689528000)>, <Thread(tpool_thread_4, started daemon 131673681135296)>, <Thread(tpool_thread_5, started daemon 131673672726208)>, <Thread(tpool_thread_6, started daemon 131673664317120)>, <Thread(tpool_thread_7, started daemon 131673655908032)>, <Thread(tpool_thread_8, started daemon 131673647498944)>, <Thread(tpool_thread_9, started daemon 131673639089856)>, <Thread(tpool_thread_10, started daemon 131673630680768)>, <Thread(tpool_thread_11, started daemon 131673622271680)>, <Thread(tpool_thread_12, started daemon 131673613862592)>, <Thread(tpool_thread_13, started daemon 131673605453504)>, <Thread(tpool_thread_14, started daemon 131673597044416)>, <Thread(tpool_thread_15, started daemon 131673588635328)>, <Thread(tpool_thread_16, started daemon 131673580226240)>, <Thread(tpool_thread_17, started daemon 131673571817152)>, <Thread(tpool_thread_18, started daemon 131673563408064)>, <Thread(tpool_thread_19, started daemon 131673554998976)>] {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 16:04:03 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:04:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Flow 'volume_create_manager' (0018931c-4f61-412a-abc1-d763ba6cadc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:04:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740b975f-66f9-4712-881c-abb1ba924f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740b975f-66f9-4712-881c-abb1ba924f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1218991645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a8240f2-725a-466c-bd2f-34075aced640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba04290189484505b13157ef37caf6b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:03Z,use_quota=True,user_id='ec1ef2ac1a544bffb5e44cb847a1b31d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1dc3fa3-fb47-409e-bb10-a69272aca5a0),volume_type_id=e1dc3fa3-fb47-409e-bb10-a69272aca5a0)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673b6820-4c5a-464c-af2c-ba72c31bf8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673b6820-4c5a-464c-af2c-ba72c31bf8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81fdd375-4c77-4d20-962a-1f45faaa3059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81fdd375-4c77-4d20-962a-1f45faaa3059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a8240f2-725a-466c-bd2f-34075aced640', 'volume_name': 'volume-9a8240f2-725a-466c-bd2f-34075aced640', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e6c119-2537-4a06-9f9f-6e0375c2b297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e6c119-2537-4a06-9f9f-6e0375c2b297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df406b38-97ac-4b29-92e7-84015f97a9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:03 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Volume 9a8240f2-725a-466c-bd2f-34075aced640: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a8240f2-725a-466c-bd2f-34075aced640', 'volume_size': 1}
Sep 04 16:04:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:03 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1218991645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a8240f2-725a-466c-bd2f-34075aced640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba04290189484505b13157ef37caf6b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:03Z,use_quota=True,user_id='ec1ef2ac1a544bffb5e44cb847a1b31d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1dc3fa3-fb47-409e-bb10-a69272aca5a0),volume_type_id=e1dc3fa3-fb47-409e-bb10-a69272aca5a0)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:04:03 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Creating volume 9a8240f2-725a-466c-bd2f-34075aced640 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:04:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:03 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:04:03 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:04:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:03 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:04:03 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:04:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9a8240f2-725a-466c-bd2f-34075aced640 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:03 devstack sudo[104150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9a8240f2-725a-466c-bd2f-34075aced640 1073741824
Sep 04 16:04:03 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:03 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Flow 'volume_create_manager' (c92b6e89-725a-424b-b128-391b812c4a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db76d8af-2e1d-4be2-bf9c-71e7a63654d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db76d8af-2e1d-4be2-bf9c-71e7a63654d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1246169447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9edf9a-0634-4194-8aa1-2d3837c18d67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba04290189484505b13157ef37caf6b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:04Z,use_quota=True,user_id='ec1ef2ac1a544bffb5e44cb847a1b31d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5fca257-29b7-4747-b7e5-6174694b184e),volume_type_id=b5fca257-29b7-4747-b7e5-6174694b184e)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e7e61c-496d-4b29-b5e6-eaedf91f5d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e7e61c-496d-4b29-b5e6-eaedf91f5d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa3b3bc-dd4b-4eec-805e-39585082c64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa3b3bc-dd4b-4eec-805e-39585082c64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f9edf9a-0634-4194-8aa1-2d3837c18d67', 'volume_name': 'volume-7f9edf9a-0634-4194-8aa1-2d3837c18d67', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f167d065-ca38-49ad-843f-e834080a860e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f167d065-ca38-49ad-843f-e834080a860e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a84e8d0c-78b0-4f5b-bb6f-d6535e6139f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:04 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Volume 7f9edf9a-0634-4194-8aa1-2d3837c18d67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f9edf9a-0634-4194-8aa1-2d3837c18d67', 'volume_size': 1}
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:04 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9a8240f2-725a-466c-bd2f-34075aced640 1073741824" returned: 0 in 0.712s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9a8240f2-725a-466c-bd2f-34075aced640 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:04 devstack sudo[104155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9a8240f2-725a-466c-bd2f-34075aced640
Sep 04 16:04:04 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:04 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9a8240f2-725a-466c-bd2f-34075aced640" returned: 0 in 0.354s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.667s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1246169447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9edf9a-0634-4194-8aa1-2d3837c18d67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba04290189484505b13157ef37caf6b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:04Z,use_quota=True,user_id='ec1ef2ac1a544bffb5e44cb847a1b31d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5fca257-29b7-4747-b7e5-6174694b184e),volume_type_id=b5fca257-29b7-4747-b7e5-6174694b184e)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Creating volume 7f9edf9a-0634-4194-8aa1-2d3837c18d67 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:04:04 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9edf9a-0634-4194-8aa1-2d3837c18d67 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:04 devstack sudo[104159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9edf9a-0634-4194-8aa1-2d3837c18d67 1073741824
Sep 04 16:04:04 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df406b38-97ac-4b29-92e7-84015f97a9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a8240f2-725a-466c-bd2f-34075aced640', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d200c84-6e6d-4a5c-a861-cd4dafc2643d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:04 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Volume volume-9a8240f2-725a-466c-bd2f-34075aced640 (9a8240f2-725a-466c-bd2f-34075aced640): created successfully
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d200c84-6e6d-4a5c-a861-cd4dafc2643d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Flow 'volume_create_manager' (0018931c-4f61-412a-abc1-d763ba6cadc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:04:04 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-1be45bd1-b4a0-43e0-b62e-7543c92e4410 tempest-TestInstancesWithCinderVolumes-717012801 None] Created volume successfully.
Sep 04 16:04:04 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:04:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Flow 'volume_create_manager' (2d6d1542-f739-47c5-b767-3d66eb6d2716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:04:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (075b3c87-ae0c-4723-97d2-9817d2a11a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (075b3c87-ae0c-4723-97d2-9817d2a11a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-8797180',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c803b736-e753-4380-b0fe-6555e14d23a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba04290189484505b13157ef37caf6b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:05Z,use_quota=True,user_id='ec1ef2ac1a544bffb5e44cb847a1b31d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8119bef-9432-4773-8ca0-e805b9700d30),volume_type_id=a8119bef-9432-4773-8ca0-e805b9700d30)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5509e14-b362-4fc9-9896-0bc004b678d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5509e14-b362-4fc9-9896-0bc004b678d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf21402-0e18-4c96-bb51-839de4611371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:05 devstack cinder-volume[87504]: DEBUG cinder.image.glance [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Creating Keystone auth plugin from conf {{(pid=87504) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 04 16:04:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf21402-0e18-4c96-bb51-839de4611371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c803b736-e753-4380-b0fe-6555e14d23a2', 'volume_name': 'volume-c803b736-e753-4380-b0fe-6555e14d23a2', 'volume_size': 1, 'image_id': '538afea7-4888-4df0-8211-d03e1f2483b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/538afea7-4888-4df0-8211-d03e1f2483b2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--349415255', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ba04290189484505b13157ef37caf6b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '538afea7-4888-4df0-8211-d03e1f2483b2', 'created_at': datetime.datetime(2026, 9, 4, 14, 4, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 4, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/538afea7-4888-4df0-8211-d03e1f2483b2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1a2ea78c0>}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7271155d-2898-4b73-ada8-4d2d8f1a6765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7271155d-2898-4b73-ada8-4d2d8f1a6765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef73bcb-c8ed-450a-96c8-9ee39aecbde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:05 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Volume c803b736-e753-4380-b0fe-6555e14d23a2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c803b736-e753-4380-b0fe-6555e14d23a2', 'volume_size': 1, 'image_id': '538afea7-4888-4df0-8211-d03e1f2483b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/538afea7-4888-4df0-8211-d03e1f2483b2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--349415255', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ba04290189484505b13157ef37caf6b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '538afea7-4888-4df0-8211-d03e1f2483b2', 'created_at': datetime.datetime(2026, 9, 4, 14, 4, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 4, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/538afea7-4888-4df0-8211-d03e1f2483b2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1a2ea78c0>}
Sep 04 16:04:05 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Trying to clone c803b736-e753-4380-b0fe-6555e14d23a2 from image 538afea7-4888-4df0-8211-d03e1f2483b2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/538afea7-4888-4df0-8211-d03e1f2483b2', 'metadata': {}}]). {{(pid=87504) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 04 16:04:05 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9edf9a-0634-4194-8aa1-2d3837c18d67 1073741824" returned: 0 in 1.073s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9edf9a-0634-4194-8aa1-2d3837c18d67 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:06 devstack sudo[104217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9edf9a-0634-4194-8aa1-2d3837c18d67
Sep 04 16:04:06 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:06 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-317e5bd3-1d53-4eb9-8d26-878471adbab7 req-f17241ed-0ce6-441a-b683-dd8d10f90f1f tempest-TestShelveInstance-1989432834 None] Terminate volume connection completed successfully.
Sep 04 16:04:06 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-317e5bd3-1d53-4eb9-8d26-878471adbab7 req-f17241ed-0ce6-441a-b683-dd8d10f90f1f tempest-TestShelveInstance-1989432834 None] Deleting attachment 6a17931c-0da9-4099-89be-4d34aac1f024. {{(pid=87504) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 16:04:06 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9edf9a-0634-4194-8aa1-2d3837c18d67" returned: 0 in 0.371s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:04:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:06 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a84e8d0c-78b0-4f5b-bb6f-d6535e6139f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f9edf9a-0634-4194-8aa1-2d3837c18d67', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:06 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a56292-b408-4837-993d-a2546ccc16bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:06 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Volume volume-7f9edf9a-0634-4194-8aa1-2d3837c18d67 (7f9edf9a-0634-4194-8aa1-2d3837c18d67): created successfully
Sep 04 16:04:06 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a56292-b408-4837-993d-a2546ccc16bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:06 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Flow 'volume_create_manager' (c92b6e89-725a-424b-b128-391b812c4a09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:04:06 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-1873c053-2e75-4ea0-a639-a0a36a6c5202 tempest-TestInstancesWithCinderVolumes-717012801 None] Created volume successfully.
Sep 04 16:04:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-8dde0b15-3772-4fd0-a189-69f529144e83 req-79f78b21-ce73-4faa-a36f-c2fcddfaf371 tempest-TestShelveInstance-1989432834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-8dde0b15-3772-4fd0-a189-69f529144e83 req-79f78b21-ce73-4faa-a36f-c2fcddfaf371 tempest-TestShelveInstance-1989432834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-8dde0b15-3772-4fd0-a189-69f529144e83 req-79f78b21-ce73-4faa-a36f-c2fcddfaf371 tempest-TestShelveInstance-1989432834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-8dde0b15-3772-4fd0-a189-69f529144e83 req-79f78b21-ce73-4faa-a36f-c2fcddfaf371 tempest-TestShelveInstance-1989432834 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236', 'name': 'volume-ba75d1c8-37db-4a1d-817f-9aa6fa964683', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e269598-afd7-4bda-a7f8-67a06c6dd0f4', 'enforce_multipath': True} {{(pid=87504) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 16:04:08 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-8dde0b15-3772-4fd0-a189-69f529144e83 req-79f78b21-ce73-4faa-a36f-c2fcddfaf371 tempest-TestShelveInstance-1989432834 None] attachment_update completed successfully.
Sep 04 16:04:10 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_538afea7-4888-4df0-8211-d03e1f2483b2_oicfwpthdevstack@QuobyteHD, size 20.69 MB, duration 4.41 sec {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 04 16:04:10 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Image download 20.69 MB at 4.69 MB/s
Sep 04 16:04:10 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[68614d93-69ae-4646-8aff-dc3f9ac723e4]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:04:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_538afea7-4888-4df0-8211-d03e1f2483b2_oicfwpthdevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-3b5f28d9-f62f-4887-96fb-c382adad6ced req-9e368f1c-6ba5-4c89-940e-446094ad1920 tempest-TestStampPattern-391961132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-3b5f28d9-f62f-4887-96fb-c382adad6ced req-9e368f1c-6ba5-4c89-940e-446094ad1920 tempest-TestStampPattern-391961132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-3b5f28d9-f62f-4887-96fb-c382adad6ced req-9e368f1c-6ba5-4c89-940e-446094ad1920 tempest-TestStampPattern-391961132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-3b5f28d9-f62f-4887-96fb-c382adad6ced req-9e368f1c-6ba5-4c89-940e-446094ad1920 tempest-TestStampPattern-391961132 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236', 'name': 'volume-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3217a06f-9b04-42bd-bcd4-5d73313f5010', 'enforce_multipath': True} {{(pid=87504) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 16:04:10 devstack sudo[104248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_538afea7-4888-4df0-8211-d03e1f2483b2_oicfwpthdevstack@QuobyteHD
Sep 04 16:04:10 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:10 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-3b5f28d9-f62f-4887-96fb-c382adad6ced req-9e368f1c-6ba5-4c89-940e-446094ad1920 tempest-TestStampPattern-391961132 None] attachment_update completed successfully.
Sep 04 16:04:10 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_538afea7-4888-4df0-8211-d03e1f2483b2_oicfwpthdevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:10 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Temporary image 538afea7-4888-4df0-8211-d03e1f2483b2 is fetched for user ec1ef2ac1a544bffb5e44cb847a1b31d. {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 04 16:04:10 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cb8e16-3519-44ec-ab66-9a01a85029c7]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:04:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_538afea7-4888-4df0-8211-d03e1f2483b2_oicfwpthdevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:10 devstack sudo[104321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_538afea7-4888-4df0-8211-d03e1f2483b2_oicfwpthdevstack@QuobyteHD
Sep 04 16:04:10 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:11 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_538afea7-4888-4df0-8211-d03e1f2483b2_oicfwpthdevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-8797180',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c803b736-e753-4380-b0fe-6555e14d23a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba04290189484505b13157ef37caf6b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:05Z,use_quota=True,user_id='ec1ef2ac1a544bffb5e44cb847a1b31d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8119bef-9432-4773-8ca0-e805b9700d30),volume_type_id=a8119bef-9432-4773-8ca0-e805b9700d30)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:04:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Creating volume c803b736-e753-4380-b0fe-6555e14d23a2 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:04:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:04:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:04:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:04:11 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:04:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c803b736-e753-4380-b0fe-6555e14d23a2 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:11 devstack sudo[104642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c803b736-e753-4380-b0fe-6555e14d23a2 1073741824
Sep 04 16:04:11 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:11 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c803b736-e753-4380-b0fe-6555e14d23a2 1073741824" returned: 0 in 0.626s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c803b736-e753-4380-b0fe-6555e14d23a2 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:11 devstack sudo[104648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c803b736-e753-4380-b0fe-6555e14d23a2
Sep 04 16:04:11 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:12 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c803b736-e753-4380-b0fe-6555e14d23a2" returned: 0 in 0.559s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:04:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:12 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Attempting download of 538afea7-4888-4df0-8211-d03e1f2483b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/538afea7-4888-4df0-8211-d03e1f2483b2', 'metadata': {}}])) to volume c803b736-e753-4380-b0fe-6555e14d23a2. {{(pid=87504) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 04 16:04:12 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddde1d0-deea-410e-9993-b40163b094fe]: (4, 'raw') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:04:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_538afea7-4888-4df0-8211-d03e1f2483b2_lrxr4icj {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:12 devstack sudo[104702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_538afea7-4888-4df0-8211-d03e1f2483b2_lrxr4icj
Sep 04 16:04:12 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:13 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_538afea7-4888-4df0-8211-d03e1f2483b2_lrxr4icj" returned: 0 in 0.601s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_538afea7-4888-4df0-8211-d03e1f2483b2_lrxr4icj {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:13 devstack sudo[104732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_538afea7-4888-4df0-8211-d03e1f2483b2_lrxr4icj
Sep 04 16:04:13 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:13 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_538afea7-4888-4df0-8211-d03e1f2483b2_lrxr4icj" returned: 1 in 0.450s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_538afea7-4888-4df0-8211-d03e1f2483b2_lrxr4icj' failed. Not Retrying. {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 16:04:13 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[828a12d8-91ac-4b3c-8a67-1d6fae7b13e5]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:04:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_538afea7-4888-4df0-8211-d03e1f2483b2_oicfwpthdevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:13 devstack sudo[104740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_538afea7-4888-4df0-8211-d03e1f2483b2_oicfwpthdevstack@QuobyteHD
Sep 04 16:04:13 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:14 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_538afea7-4888-4df0-8211-d03e1f2483b2_oicfwpthdevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:14 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] 538afea7-4888-4df0-8211-d03e1f2483b2 was qcow2, converting to qcow2 {{(pid=87504) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 04 16:04:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_538afea7-4888-4df0-8211-d03e1f2483b2_oicfwpthdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c803b736-e753-4380-b0fe-6555e14d23a2 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:14 devstack sudo[104750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_538afea7-4888-4df0-8211-d03e1f2483b2_oicfwpthdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c803b736-e753-4380-b0fe-6555e14d23a2
Sep 04 16:04:14 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:14 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-b8a4d735-31c6-448a-89d7-0f9d993ce475 req-f101da73-f4c7-4bd2-a0c7-4fbc406a10e4 tempest-TestStampPattern-391961132 None] Terminate volume connection completed successfully.
Sep 04 16:04:14 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-b8a4d735-31c6-448a-89d7-0f9d993ce475 req-f101da73-f4c7-4bd2-a0c7-4fbc406a10e4 tempest-TestStampPattern-391961132 None] Deleting attachment 3217a06f-9b04-42bd-bcd4-5d73313f5010. {{(pid=87504) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 16:04:16 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_538afea7-4888-4df0-8211-d03e1f2483b2_oicfwpthdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c803b736-e753-4380-b0fe-6555e14d23a2" returned: 0 in 2.278s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:16 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_538afea7-4888-4df0-8211-d03e1f2483b2_oicfwpthdevstack@QuobyteHD, size 112.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c803b736-e753-4380-b0fe-6555e14d23a2 {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 16:04:16 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Converted 112.00 MB image at 49.14 MB/s
Sep 04 16:04:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c803b736-e753-4380-b0fe-6555e14d23a2 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:16 devstack sudo[104768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c803b736-e753-4380-b0fe-6555e14d23a2 1G
Sep 04 16:04:16 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:16 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c803b736-e753-4380-b0fe-6555e14d23a2 1G" returned: 0 in 0.683s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:16 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Downloaded image 538afea7-4888-4df0-8211-d03e1f2483b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/538afea7-4888-4df0-8211-d03e1f2483b2', 'metadata': {}}])) to volume c803b736-e753-4380-b0fe-6555e14d23a2 successfully. {{(pid=87504) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 04 16:04:17 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Temporary image 538afea7-4888-4df0-8211-d03e1f2483b2 for user ec1ef2ac1a544bffb5e44cb847a1b31d is deleted. {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 04 16:04:17 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Marking volume c803b736-e753-4380-b0fe-6555e14d23a2 as bootable. {{(pid=87504) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 04 16:04:17 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Copying metadata from image 538afea7-4888-4df0-8211-d03e1f2483b2 to c803b736-e753-4380-b0fe-6555e14d23a2. {{(pid=87504) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 04 16:04:17 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Creating volume glance metadata for volume c803b736-e753-4380-b0fe-6555e14d23a2 backed by image 538afea7-4888-4df0-8211-d03e1f2483b2 with: {'image_id': '538afea7-4888-4df0-8211-d03e1f2483b2', 'image_name': 'tempest-scenario-img--349415255', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87504) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 04 16:04:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef73bcb-c8ed-450a-96c8-9ee39aecbde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c803b736-e753-4380-b0fe-6555e14d23a2', 'volume_size': 1, 'image_id': '538afea7-4888-4df0-8211-d03e1f2483b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/538afea7-4888-4df0-8211-d03e1f2483b2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--349415255', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ba04290189484505b13157ef37caf6b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '538afea7-4888-4df0-8211-d03e1f2483b2', 'created_at': datetime.datetime(2026, 9, 4, 14, 4, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 4, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/538afea7-4888-4df0-8211-d03e1f2483b2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1a2ea78c0>}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c898a1-13d9-4da2-8b1b-935856102ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:17 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Volume volume-c803b736-e753-4380-b0fe-6555e14d23a2 (c803b736-e753-4380-b0fe-6555e14d23a2): created successfully
Sep 04 16:04:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c898a1-13d9-4da2-8b1b-935856102ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Flow 'volume_create_manager' (2d6d1542-f739-47c5-b767-3d66eb6d2716) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:04:17 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-913e64b4-9fa3-4766-8746-76b9c331b235 tempest-TestInstancesWithCinderVolumes-717012801 None] Created volume successfully.
Sep 04 16:04:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ef577ad7-7627-4a8e-9d39-f3470f3b0337 tempest-TestStampPattern-391961132 None] Acquiring lock "cinder-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:04:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ef577ad7-7627-4a8e-9d39-f3470f3b0337 tempest-TestStampPattern-391961132 None] Lock "cinder-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:04:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ef577ad7-7627-4a8e-9d39-f3470f3b0337 tempest-TestStampPattern-391961132 None] Acquiring lock "cinder-quobyte-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:04:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ef577ad7-7627-4a8e-9d39-f3470f3b0337 tempest-TestStampPattern-391961132 None] Lock "cinder-quobyte-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:04:19 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6652c2f4-622a-45ce-85bc-029585ca9d43]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:04:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ef577ad7-7627-4a8e-9d39-f3470f3b0337 tempest-TestStampPattern-391961132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:19 devstack sudo[104795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3
Sep 04 16:04:19 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:19 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ef577ad7-7627-4a8e-9d39-f3470f3b0337 tempest-TestStampPattern-391961132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3" returned: 0 in 0.525s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ef577ad7-7627-4a8e-9d39-f3470f3b0337 tempest-TestStampPattern-391961132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:19 devstack sudo[104809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3
Sep 04 16:04:19 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:19 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ef577ad7-7627-4a8e-9d39-f3470f3b0337 tempest-TestStampPattern-391961132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3" returned: 0 in 0.304s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ef577ad7-7627-4a8e-9d39-f3470f3b0337 tempest-TestStampPattern-391961132 None] Lock "cinder-quobyte-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3" released by "delete_volume" :: held 0.891s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:04:20 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-ef577ad7-7627-4a8e-9d39-f3470f3b0337 tempest-TestStampPattern-391961132 None] Created reservations ['dc17a15c-891d-4ce1-b2ae-cdecbeeecbd7', '03213209-a107-4f1d-a883-25e9da43676c', '1366f1c2-66ed-43fa-a01a-3913096b3cae', '82d1c78c-5365-466c-840d-4f533318e3fa'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:04:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ef577ad7-7627-4a8e-9d39-f3470f3b0337 tempest-TestStampPattern-391961132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ef577ad7-7627-4a8e-9d39-f3470f3b0337 tempest-TestStampPattern-391961132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ef577ad7-7627-4a8e-9d39-f3470f3b0337 tempest-TestStampPattern-391961132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:04:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ef577ad7-7627-4a8e-9d39-f3470f3b0337 tempest-TestStampPattern-391961132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:04:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ef577ad7-7627-4a8e-9d39-f3470f3b0337 tempest-TestStampPattern-391961132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ef577ad7-7627-4a8e-9d39-f3470f3b0337 tempest-TestStampPattern-391961132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:20 devstack sudo[104812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:04:20 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:20 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ef577ad7-7627-4a8e-9d39-f3470f3b0337 tempest-TestStampPattern-391961132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.352s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:20 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ef577ad7-7627-4a8e-9d39-f3470f3b0337 tempest-TestStampPattern-391961132 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:04:20 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-ef577ad7-7627-4a8e-9d39-f3470f3b0337 tempest-TestStampPattern-391961132 None] Deleted volume successfully.
Sep 04 16:04:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ef577ad7-7627-4a8e-9d39-f3470f3b0337 tempest-TestStampPattern-391961132 None] Lock "cinder-ca1a9d97-ac63-4b02-a99e-db939a2e3ef3-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:04:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3dc29475-6296-4768-8d1b-fbc5bb57384f tempest-TestStampPattern-391961132 None] Acquiring lock "cinder-ac8cb290-dbb1-4786-891a-a3d870e93bda-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:04:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3dc29475-6296-4768-8d1b-fbc5bb57384f tempest-TestStampPattern-391961132 None] Lock "cinder-ac8cb290-dbb1-4786-891a-a3d870e93bda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:04:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3dc29475-6296-4768-8d1b-fbc5bb57384f tempest-TestStampPattern-391961132 None] Acquiring lock "cinder-quobyte-7effc614-7270-4918-b415-95a8238c156e" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:04:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3dc29475-6296-4768-8d1b-fbc5bb57384f tempest-TestStampPattern-391961132 None] Lock "cinder-quobyte-7effc614-7270-4918-b415-95a8238c156e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:04:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3dc29475-6296-4768-8d1b-fbc5bb57384f tempest-TestStampPattern-391961132 None] Acquiring lock "cinder-quobyte-ac8cb290-dbb1-4786-891a-a3d870e93bda" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:04:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3dc29475-6296-4768-8d1b-fbc5bb57384f tempest-TestStampPattern-391961132 None] Lock "cinder-quobyte-ac8cb290-dbb1-4786-891a-a3d870e93bda" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:04:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-3dc29475-6296-4768-8d1b-fbc5bb57384f tempest-TestStampPattern-391961132 None] Deleting offline snapshot ac8cb290-dbb1-4786-891a-a3d870e93bda of volume 7effc614-7270-4918-b415-95a8238c156e {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 16:04:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-3dc29475-6296-4768-8d1b-fbc5bb57384f tempest-TestStampPattern-391961132 None] snapshot_file for this snap is: volume-7effc614-7270-4918-b415-95a8238c156e.ac8cb290-dbb1-4786-891a-a3d870e93bda {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 16:04:20 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c9b32c-6dcb-4788-8f28-b55e31d6233c]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:04:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3dc29475-6296-4768-8d1b-fbc5bb57384f tempest-TestStampPattern-391961132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.ac8cb290-dbb1-4786-891a-a3d870e93bda {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:21 devstack sudo[104815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.ac8cb290-dbb1-4786-891a-a3d870e93bda
Sep 04 16:04:21 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:21 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3dc29475-6296-4768-8d1b-fbc5bb57384f tempest-TestStampPattern-391961132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.ac8cb290-dbb1-4786-891a-a3d870e93bda" returned: 0 in 0.471s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-3dc29475-6296-4768-8d1b-fbc5bb57384f tempest-TestStampPattern-391961132 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7effc614-7270-4918-b415-95a8238c156e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:04:21 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[89eef2b6-9666-40b5-9c2b-85297bfa3541]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:04:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3dc29475-6296-4768-8d1b-fbc5bb57384f tempest-TestStampPattern-391961132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-9db91dea-0007-48ab-a9be-33bb453786dd req-a9a19141-9366-44cc-ac60-df1cf35d10e2 tempest-TestInstancesWithCinderVolumes-717012801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-9db91dea-0007-48ab-a9be-33bb453786dd req-a9a19141-9366-44cc-ac60-df1cf35d10e2 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-9db91dea-0007-48ab-a9be-33bb453786dd req-a9a19141-9366-44cc-ac60-df1cf35d10e2 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-9db91dea-0007-48ab-a9be-33bb453786dd req-a9a19141-9366-44cc-ac60-df1cf35d10e2 tempest-TestInstancesWithCinderVolumes-717012801 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236', 'name': 'volume-c803b736-e753-4380-b0fe-6555e14d23a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a6375f7-a473-4332-8606-667a6cb9686f', 'enforce_multipath': True} {{(pid=87504) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 16:04:21 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-9db91dea-0007-48ab-a9be-33bb453786dd req-a9a19141-9366-44cc-ac60-df1cf35d10e2 tempest-TestInstancesWithCinderVolumes-717012801 None] attachment_update completed successfully.
Sep 04 16:04:21 devstack sudo[104833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e
Sep 04 16:04:21 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:22 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3dc29475-6296-4768-8d1b-fbc5bb57384f tempest-TestStampPattern-391961132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e" returned: 0 in 0.915s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3dc29475-6296-4768-8d1b-fbc5bb57384f tempest-TestStampPattern-391961132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.ac8cb290-dbb1-4786-891a-a3d870e93bda {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:22 devstack sudo[104840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.ac8cb290-dbb1-4786-891a-a3d870e93bda
Sep 04 16:04:22 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:22 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3dc29475-6296-4768-8d1b-fbc5bb57384f tempest-TestStampPattern-391961132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.ac8cb290-dbb1-4786-891a-a3d870e93bda" returned: 0 in 0.392s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3dc29475-6296-4768-8d1b-fbc5bb57384f tempest-TestStampPattern-391961132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.ac8cb290-dbb1-4786-891a-a3d870e93bda {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:22 devstack sudo[104846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.ac8cb290-dbb1-4786-891a-a3d870e93bda
Sep 04 16:04:22 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:22 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3dc29475-6296-4768-8d1b-fbc5bb57384f tempest-TestStampPattern-391961132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e.ac8cb290-dbb1-4786-891a-a3d870e93bda" returned: 0 in 0.284s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3dc29475-6296-4768-8d1b-fbc5bb57384f tempest-TestStampPattern-391961132 None] Lock "cinder-quobyte-ac8cb290-dbb1-4786-891a-a3d870e93bda" released by "_delete_snapshot" :: held 2.225s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:04:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3dc29475-6296-4768-8d1b-fbc5bb57384f tempest-TestStampPattern-391961132 None] Lock "cinder-quobyte-7effc614-7270-4918-b415-95a8238c156e" released by "delete_snapshot" :: held 2.258s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:04:23 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-3dc29475-6296-4768-8d1b-fbc5bb57384f tempest-TestStampPattern-391961132 None] Created reservations ['4da22313-aa79-40ef-ae18-c145308446d8', '93753eac-e37d-47cd-be1b-24df85ebeada', '2c72d5d4-6ff5-49ec-ae25-4f631f2bd201', 'a3179388-610f-444d-94bd-c7ec6537ae08'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:04:23 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-3dc29475-6296-4768-8d1b-fbc5bb57384f tempest-TestStampPattern-391961132 None] Delete snapshot completed successfully.
Sep 04 16:04:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3dc29475-6296-4768-8d1b-fbc5bb57384f tempest-TestStampPattern-391961132 None] Lock "cinder-ac8cb290-dbb1-4786-891a-a3d870e93bda-delete_snapshot" released by "delete_snapshot" :: held 2.446s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:04:29 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a1200f3d-945f-4efd-a232-3f38f8abc2e7 tempest-TestStampPattern-391961132 None] Acquiring lock "cinder-7effc614-7270-4918-b415-95a8238c156e-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:04:29 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a1200f3d-945f-4efd-a232-3f38f8abc2e7 tempest-TestStampPattern-391961132 None] Lock "cinder-7effc614-7270-4918-b415-95a8238c156e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:04:29 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a1200f3d-945f-4efd-a232-3f38f8abc2e7 tempest-TestStampPattern-391961132 None] Acquiring lock "cinder-quobyte-7effc614-7270-4918-b415-95a8238c156e" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:04:29 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a1200f3d-945f-4efd-a232-3f38f8abc2e7 tempest-TestStampPattern-391961132 None] Lock "cinder-quobyte-7effc614-7270-4918-b415-95a8238c156e" acquired by "delete_volume" :: waited 0.030s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:04:30 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93839cd-a751-4e4b-8da7-7b5d4b8c8d9c]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:04:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a1200f3d-945f-4efd-a232-3f38f8abc2e7 tempest-TestStampPattern-391961132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:30 devstack sudo[104942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e
Sep 04 16:04:30 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:30 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a1200f3d-945f-4efd-a232-3f38f8abc2e7 tempest-TestStampPattern-391961132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e" returned: 0 in 0.528s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a1200f3d-945f-4efd-a232-3f38f8abc2e7 tempest-TestStampPattern-391961132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:30 devstack sudo[104983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e
Sep 04 16:04:30 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:30 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a1200f3d-945f-4efd-a232-3f38f8abc2e7 tempest-TestStampPattern-391961132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7effc614-7270-4918-b415-95a8238c156e" returned: 0 in 0.379s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:30 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a1200f3d-945f-4efd-a232-3f38f8abc2e7 tempest-TestStampPattern-391961132 None] Lock "cinder-quobyte-7effc614-7270-4918-b415-95a8238c156e" released by "delete_volume" :: held 1.013s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:04:31 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-a1200f3d-945f-4efd-a232-3f38f8abc2e7 tempest-TestStampPattern-391961132 None] Created reservations ['f2e955cd-b495-431e-8cfe-f77c621b2025', '5deca3f4-896d-493b-9c92-43b55f7b7863', 'f60bc0f3-51de-4dce-abd3-44c6a65c7684', '8bb3b081-0e1f-4317-9643-3f8ca47ff82b'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:04:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a1200f3d-945f-4efd-a232-3f38f8abc2e7 tempest-TestStampPattern-391961132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a1200f3d-945f-4efd-a232-3f38f8abc2e7 tempest-TestStampPattern-391961132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a1200f3d-945f-4efd-a232-3f38f8abc2e7 tempest-TestStampPattern-391961132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:04:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a1200f3d-945f-4efd-a232-3f38f8abc2e7 tempest-TestStampPattern-391961132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:04:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a1200f3d-945f-4efd-a232-3f38f8abc2e7 tempest-TestStampPattern-391961132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a1200f3d-945f-4efd-a232-3f38f8abc2e7 tempest-TestStampPattern-391961132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:31 devstack sudo[104986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:04:31 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:31 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a1200f3d-945f-4efd-a232-3f38f8abc2e7 tempest-TestStampPattern-391961132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.387s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:31 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-a1200f3d-945f-4efd-a232-3f38f8abc2e7 tempest-TestStampPattern-391961132 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:04:31 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-a1200f3d-945f-4efd-a232-3f38f8abc2e7 tempest-TestStampPattern-391961132 None] Deleted volume successfully.
Sep 04 16:04:31 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a1200f3d-945f-4efd-a232-3f38f8abc2e7 tempest-TestStampPattern-391961132 None] Lock "cinder-7effc614-7270-4918-b415-95a8238c156e-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:04:41 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=54,cinder:UPDATE=34,cinder:DELETE=1,cinder:INSERT=11 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:04:41 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=44,cinder:UPDATE=40,cinder:INSERT=13,cinder:DELETE=4 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Flow 'volume_create_manager' (312fb951-a304-44d7-9314-2830a432f98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aaf15fd-8e51-4f42-be03-e65d1f732a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aaf15fd-8e51-4f42-be03-e65d1f732a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1572891164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414230a4-3f29-415e-9282-816f2be0c91b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74600e4b31ad4ec99179a0300762e934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:46Z,use_quota=True,user_id='92391957cd684d938902f04cb5d29890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da49dc6-9d80-439c-825b-ba83d029cff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da49dc6-9d80-439c-825b-ba83d029cff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d11f691-f6b3-45ef-96da-5911ae15546c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d11f691-f6b3-45ef-96da-5911ae15546c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '414230a4-3f29-415e-9282-816f2be0c91b', 'volume_name': 'volume-414230a4-3f29-415e-9282-816f2be0c91b', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c4e8b9-2d7e-4b9e-b38a-b5ed0ef8a226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c4e8b9-2d7e-4b9e-b38a-b5ed0ef8a226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94bd83cd-029e-4d7e-9d0a-2b33f6210974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:46 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Volume 414230a4-3f29-415e-9282-816f2be0c91b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-414230a4-3f29-415e-9282-816f2be0c91b', 'volume_size': 1}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1572891164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414230a4-3f29-415e-9282-816f2be0c91b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74600e4b31ad4ec99179a0300762e934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:46Z,use_quota=True,user_id='92391957cd684d938902f04cb5d29890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Creating volume 414230a4-3f29-415e-9282-816f2be0c91b {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:04:46 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-414230a4-3f29-415e-9282-816f2be0c91b 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:46 devstack sudo[105005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-414230a4-3f29-415e-9282-816f2be0c91b 1073741824
Sep 04 16:04:46 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Flow 'volume_create_manager' (f6eead9b-8a50-4b19-97db-b3f8732bf55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12830f20-dd1c-4ce5-b0bf-e03cc63ac651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12830f20-dd1c-4ce5-b0bf-e03cc63ac651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-940314955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4141d28-bb8b-4141-a15b-1405f86b7d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74600e4b31ad4ec99179a0300762e934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:46Z,use_quota=True,user_id='92391957cd684d938902f04cb5d29890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a6ac0f-cf28-4799-a1b5-be59d57df90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a6ac0f-cf28-4799-a1b5-be59d57df90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028e6de2-fe69-43f1-9361-ec53cedc181d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028e6de2-fe69-43f1-9361-ec53cedc181d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4141d28-bb8b-4141-a15b-1405f86b7d31', 'volume_name': 'volume-b4141d28-bb8b-4141-a15b-1405f86b7d31', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4af6b221-749d-449e-9224-94b0cfe61272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4af6b221-749d-449e-9224-94b0cfe61272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad95a41-ad5a-464e-86e1-c4dd31003d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:46 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Volume b4141d28-bb8b-4141-a15b-1405f86b7d31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4141d28-bb8b-4141-a15b-1405f86b7d31', 'volume_size': 1}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:46 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-414230a4-3f29-415e-9282-816f2be0c91b 1073741824" returned: 0 in 0.551s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-414230a4-3f29-415e-9282-816f2be0c91b {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:46 devstack sudo[105011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-414230a4-3f29-415e-9282-816f2be0c91b
Sep 04 16:04:46 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:04:47 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Flow 'volume_create_manager' (4191f595-0f55-4875-bace-934f8e0352d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d7e25a-efb8-4efb-a06a-49ad8c8717e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-414230a4-3f29-415e-9282-816f2be0c91b" returned: 0 in 0.295s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.527s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-940314955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4141d28-bb8b-4141-a15b-1405f86b7d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74600e4b31ad4ec99179a0300762e934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:46Z,use_quota=True,user_id='92391957cd684d938902f04cb5d29890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Creating volume b4141d28-bb8b-4141-a15b-1405f86b7d31 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:04:47 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b4141d28-bb8b-4141-a15b-1405f86b7d31 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d7e25a-efb8-4efb-a06a-49ad8c8717e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1399193976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd7b8aa-193f-4a62-9a2d-041e0ad1b773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74600e4b31ad4ec99179a0300762e934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:47Z,use_quota=True,user_id='92391957cd684d938902f04cb5d29890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:47 devstack sudo[105014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b4141d28-bb8b-4141-a15b-1405f86b7d31 1073741824
Sep 04 16:04:47 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68dc6907-8da5-4e0e-bb2c-d1f5ff5b89ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68dc6907-8da5-4e0e-bb2c-d1f5ff5b89ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf00a6b-5575-4095-b727-32d54241e7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf00a6b-5575-4095-b727-32d54241e7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fd7b8aa-193f-4a62-9a2d-041e0ad1b773', 'volume_name': 'volume-6fd7b8aa-193f-4a62-9a2d-041e0ad1b773', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e900d2ed-535b-4d7f-a005-60eb4a82ab14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e900d2ed-535b-4d7f-a005-60eb4a82ab14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f27e33e-2cc8-4722-8981-63ba991e6581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:47 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Volume 6fd7b8aa-193f-4a62-9a2d-041e0ad1b773: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fd7b8aa-193f-4a62-9a2d-041e0ad1b773', 'volume_size': 1}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94bd83cd-029e-4d7e-9d0a-2b33f6210974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-414230a4-3f29-415e-9282-816f2be0c91b', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (815bdde9-1a0c-45f3-ad34-51616ba57e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:47 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Volume volume-414230a4-3f29-415e-9282-816f2be0c91b (414230a4-3f29-415e-9282-816f2be0c91b): created successfully
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (815bdde9-1a0c-45f3-ad34-51616ba57e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Flow 'volume_create_manager' (312fb951-a304-44d7-9314-2830a432f98a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:04:47 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-db8dc5fe-ef86-4f51-89ff-25b390df70a1 tempest-CreateVolumesFromImageTest-1765526579 None] Created volume successfully.
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Flow 'volume_create_manager' (1316e016-44b0-4f6b-9896-6824e6a42bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7efe9555-be31-413d-96f4-0314dca5eb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7efe9555-be31-413d-96f4-0314dca5eb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1677879662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff990cc7-38fc-4e84-a1b5-ee67544552ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74600e4b31ad4ec99179a0300762e934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:47Z,use_quota=True,user_id='92391957cd684d938902f04cb5d29890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216b5f86-f5a6-4fed-ad38-db1c3a3d63bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216b5f86-f5a6-4fed-ad38-db1c3a3d63bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3589df3f-a450-4115-bbe1-9459a37a67e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3589df3f-a450-4115-bbe1-9459a37a67e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff990cc7-38fc-4e84-a1b5-ee67544552ed', 'volume_name': 'volume-ff990cc7-38fc-4e84-a1b5-ee67544552ed', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0cf022a-a843-4dcf-82e2-92eec2fb3615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0cf022a-a843-4dcf-82e2-92eec2fb3615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe3d2961-fa08-4962-b1fb-5157ae477431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:47 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Volume ff990cc7-38fc-4e84-a1b5-ee67544552ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff990cc7-38fc-4e84-a1b5-ee67544552ed', 'volume_size': 1}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:47 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b4141d28-bb8b-4141-a15b-1405f86b7d31 1073741824" returned: 0 in 0.516s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b4141d28-bb8b-4141-a15b-1405f86b7d31 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:47 devstack sudo[105020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b4141d28-bb8b-4141-a15b-1405f86b7d31
Sep 04 16:04:47 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Flow 'volume_create_manager' (f92e06e0-43fe-46f7-9962-cff864487f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf5912d-fb7e-41ea-8381-0be6b3854c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf5912d-fb7e-41ea-8381-0be6b3854c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-232885502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4034060e-6da5-4bd6-b859-fcdbfc5fcf1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74600e4b31ad4ec99179a0300762e934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:48Z,use_quota=True,user_id='92391957cd684d938902f04cb5d29890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c0f8cf-7286-4b51-b018-f1e1254de6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c0f8cf-7286-4b51-b018-f1e1254de6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33544dde-cdad-4391-b217-b0d9cae74990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33544dde-cdad-4391-b217-b0d9cae74990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4034060e-6da5-4bd6-b859-fcdbfc5fcf1c', 'volume_name': 'volume-4034060e-6da5-4bd6-b859-fcdbfc5fcf1c', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b972e7cc-38c5-4ac2-ac81-4ba3dde2083e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:48 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b972e7cc-38c5-4ac2-ac81-4ba3dde2083e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f666f3-beb4-4293-8038-06d43c2a92a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:48 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Volume 4034060e-6da5-4bd6-b859-fcdbfc5fcf1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4034060e-6da5-4bd6-b859-fcdbfc5fcf1c', 'volume_size': 1}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b4141d28-bb8b-4141-a15b-1405f86b7d31" returned: 0 in 0.312s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.806s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1399193976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd7b8aa-193f-4a62-9a2d-041e0ad1b773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74600e4b31ad4ec99179a0300762e934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:47Z,use_quota=True,user_id='92391957cd684d938902f04cb5d29890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Creating volume 6fd7b8aa-193f-4a62-9a2d-041e0ad1b773 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:04:48 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6fd7b8aa-193f-4a62-9a2d-041e0ad1b773 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad95a41-ad5a-464e-86e1-c4dd31003d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4141d28-bb8b-4141-a15b-1405f86b7d31', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:48 devstack sudo[105023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6fd7b8aa-193f-4a62-9a2d-041e0ad1b773 1073741824
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d144569-f5d1-4bfc-8711-062d3c774720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:48 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:48 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Volume volume-b4141d28-bb8b-4141-a15b-1405f86b7d31 (b4141d28-bb8b-4141-a15b-1405f86b7d31): created successfully
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d144569-f5d1-4bfc-8711-062d3c774720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Flow 'volume_create_manager' (f6eead9b-8a50-4b19-97db-b3f8732bf55e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:04:48 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-2c5bce01-c342-4cb7-94dc-e855d2f26714 tempest-CreateVolumesFromImageTest-1765526579 None] Created volume successfully.
Sep 04 16:04:48 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6fd7b8aa-193f-4a62-9a2d-041e0ad1b773 1073741824" returned: 0 in 0.485s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6fd7b8aa-193f-4a62-9a2d-041e0ad1b773 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:48 devstack sudo[105029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6fd7b8aa-193f-4a62-9a2d-041e0ad1b773
Sep 04 16:04:48 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:04:48 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6fd7b8aa-193f-4a62-9a2d-041e0ad1b773" returned: 0 in 0.281s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.278s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1677879662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff990cc7-38fc-4e84-a1b5-ee67544552ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74600e4b31ad4ec99179a0300762e934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:47Z,use_quota=True,user_id='92391957cd684d938902f04cb5d29890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Creating volume ff990cc7-38fc-4e84-a1b5-ee67544552ed {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:48 devstack sudo[105032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:04:48 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:04:48 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ff990cc7-38fc-4e84-a1b5-ee67544552ed 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f27e33e-2cc8-4722-8981-63ba991e6581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fd7b8aa-193f-4a62-9a2d-041e0ad1b773', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (003c4311-5faf-4c1b-bea2-00f8a10223e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:48 devstack sudo[105034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ff990cc7-38fc-4e84-a1b5-ee67544552ed 1073741824
Sep 04 16:04:48 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:48 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Volume volume-6fd7b8aa-193f-4a62-9a2d-041e0ad1b773 (6fd7b8aa-193f-4a62-9a2d-041e0ad1b773): created successfully
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (003c4311-5faf-4c1b-bea2-00f8a10223e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Flow 'volume_create_manager' (4191f595-0f55-4875-bace-934f8e0352d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:04:48 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-9a766fa9-5f75-4e82-98f7-af8eac9e5714 tempest-CreateVolumesFromImageTest-1765526579 None] Created volume successfully.
Sep 04 16:04:49 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.281s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:49 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:04:49 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager._thread_info {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 16:04:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread count: 28 {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 16:04:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread info: [<_MainThread(MainThread, started 131673838448768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131673724603200)>, <Thread(Thread-3 (stat_writer), started daemon 131673723495936)>, <Thread(Rabbit-heartbeat, started daemon 131673723764800)>, <Thread(Thread-5 (_runner), started daemon 131673722269632)>, <Thread(Thread-7 (_runner), started daemon 131673722322112)>, <Thread(fd_logger, started daemon 131673722585024)>, <Thread(privsep_reader, started daemon 131673721593984)>, <Thread(tpool_thread_0, started daemon 131673714706112)>, <Thread(tpool_thread_1, started daemon 131673706313408)>, <Thread(tpool_thread_2, started daemon 131673697920704)>, <Thread(tpool_thread_3, started daemon 131673689528000)>, <Thread(tpool_thread_4, started daemon 131673681135296)>, <Thread(tpool_thread_5, started daemon 131673672726208)>, <Thread(tpool_thread_6, started daemon 131673664317120)>, <Thread(tpool_thread_7, started daemon 131673655908032)>, <Thread(tpool_thread_8, started daemon 131673647498944)>, <Thread(tpool_thread_9, started daemon 131673639089856)>, <Thread(tpool_thread_10, started daemon 131673630680768)>, <Thread(tpool_thread_11, started daemon 131673622271680)>, <Thread(tpool_thread_12, started daemon 131673613862592)>, <Thread(tpool_thread_13, started daemon 131673605453504)>, <Thread(tpool_thread_14, started daemon 131673597044416)>, <Thread(tpool_thread_15, started daemon 131673588635328)>, <Thread(tpool_thread_16, started daemon 131673580226240)>, <Thread(tpool_thread_17, started daemon 131673571817152)>, <Thread(tpool_thread_18, started daemon 131673563408064)>, <Thread(tpool_thread_19, started daemon 131673554998976)>] {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 16:04:49 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ff990cc7-38fc-4e84-a1b5-ee67544552ed 1073741824" returned: 0 in 0.515s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ff990cc7-38fc-4e84-a1b5-ee67544552ed {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:49 devstack sudo[105041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ff990cc7-38fc-4e84-a1b5-ee67544552ed
Sep 04 16:04:49 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:49 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ff990cc7-38fc-4e84-a1b5-ee67544552ed" returned: 0 in 0.253s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:04:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.646s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-232885502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4034060e-6da5-4bd6-b859-fcdbfc5fcf1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74600e4b31ad4ec99179a0300762e934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:48Z,use_quota=True,user_id='92391957cd684d938902f04cb5d29890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:04:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Creating volume 4034060e-6da5-4bd6-b859-fcdbfc5fcf1c {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:04:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:04:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:04:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:04:49 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:04:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4034060e-6da5-4bd6-b859-fcdbfc5fcf1c 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:49 devstack sudo[105044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4034060e-6da5-4bd6-b859-fcdbfc5fcf1c 1073741824
Sep 04 16:04:49 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe3d2961-fa08-4962-b1fb-5157ae477431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff990cc7-38fc-4e84-a1b5-ee67544552ed', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3d89d8-657f-466c-b04c-495e60de980c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:49 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Volume volume-ff990cc7-38fc-4e84-a1b5-ee67544552ed (ff990cc7-38fc-4e84-a1b5-ee67544552ed): created successfully
Sep 04 16:04:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3d89d8-657f-466c-b04c-495e60de980c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Flow 'volume_create_manager' (1316e016-44b0-4f6b-9896-6824e6a42bc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:04:49 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-48213051-51d9-4924-b756-665ddc9f0892 tempest-CreateVolumesFromImageTest-1765526579 None] Created volume successfully.
Sep 04 16:04:50 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4034060e-6da5-4bd6-b859-fcdbfc5fcf1c 1073741824" returned: 0 in 0.466s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4034060e-6da5-4bd6-b859-fcdbfc5fcf1c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:50 devstack sudo[105050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4034060e-6da5-4bd6-b859-fcdbfc5fcf1c
Sep 04 16:04:50 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:50 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4034060e-6da5-4bd6-b859-fcdbfc5fcf1c" returned: 0 in 0.261s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:04:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f666f3-beb4-4293-8038-06d43c2a92a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4034060e-6da5-4bd6-b859-fcdbfc5fcf1c', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a5db63-66a5-41aa-80a2-ead62a2722fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:04:50 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Volume volume-4034060e-6da5-4bd6-b859-fcdbfc5fcf1c (4034060e-6da5-4bd6-b859-fcdbfc5fcf1c): created successfully
Sep 04 16:04:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a5db63-66a5-41aa-80a2-ead62a2722fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:04:50 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Flow 'volume_create_manager' (f92e06e0-43fe-46f7-9962-cff864487f96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:04:50 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-28e372a4-050f-4af1-ba67-9c21b5992be4 tempest-CreateVolumesFromImageTest-1765526579 None] Created volume successfully.
Sep 04 16:04:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c7382dd6-aed4-4789-a86b-1bc0546203f3 tempest-CreateVolumesFromImageTest-1765526579 None] Acquiring lock "cinder-4034060e-6da5-4bd6-b859-fcdbfc5fcf1c-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:04:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c7382dd6-aed4-4789-a86b-1bc0546203f3 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "cinder-4034060e-6da5-4bd6-b859-fcdbfc5fcf1c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:04:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c7382dd6-aed4-4789-a86b-1bc0546203f3 tempest-CreateVolumesFromImageTest-1765526579 None] Acquiring lock "cinder-quobyte-4034060e-6da5-4bd6-b859-fcdbfc5fcf1c" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:04:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c7382dd6-aed4-4789-a86b-1bc0546203f3 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "cinder-quobyte-4034060e-6da5-4bd6-b859-fcdbfc5fcf1c" acquired by "delete_volume" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:04:51 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[809f9df7-78d2-4a13-8819-b59f444c19db]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:04:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c7382dd6-aed4-4789-a86b-1bc0546203f3 tempest-CreateVolumesFromImageTest-1765526579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4034060e-6da5-4bd6-b859-fcdbfc5fcf1c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:51 devstack sudo[105059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4034060e-6da5-4bd6-b859-fcdbfc5fcf1c
Sep 04 16:04:51 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:52 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c7382dd6-aed4-4789-a86b-1bc0546203f3 tempest-CreateVolumesFromImageTest-1765526579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4034060e-6da5-4bd6-b859-fcdbfc5fcf1c" returned: 0 in 0.611s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c7382dd6-aed4-4789-a86b-1bc0546203f3 tempest-CreateVolumesFromImageTest-1765526579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4034060e-6da5-4bd6-b859-fcdbfc5fcf1c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:52 devstack sudo[105066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4034060e-6da5-4bd6-b859-fcdbfc5fcf1c
Sep 04 16:04:52 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:52 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c7382dd6-aed4-4789-a86b-1bc0546203f3 tempest-CreateVolumesFromImageTest-1765526579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4034060e-6da5-4bd6-b859-fcdbfc5fcf1c" returned: 0 in 0.608s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c7382dd6-aed4-4789-a86b-1bc0546203f3 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "cinder-quobyte-4034060e-6da5-4bd6-b859-fcdbfc5fcf1c" released by "delete_volume" :: held 1.305s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:04:53 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-c7382dd6-aed4-4789-a86b-1bc0546203f3 tempest-CreateVolumesFromImageTest-1765526579 None] Created reservations ['af8d4dcc-07ba-490f-a9a9-ec85b6f74a4d', '08a211ba-5ddd-4b5b-8a50-4eae7c8faad0', '23c259b4-61ea-4a9c-abb9-a5b08b173a11', '3ec2ec0b-e95c-497f-b3d8-32a32109a437'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:04:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c7382dd6-aed4-4789-a86b-1bc0546203f3 tempest-CreateVolumesFromImageTest-1765526579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c7382dd6-aed4-4789-a86b-1bc0546203f3 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c7382dd6-aed4-4789-a86b-1bc0546203f3 tempest-CreateVolumesFromImageTest-1765526579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:04:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c7382dd6-aed4-4789-a86b-1bc0546203f3 tempest-CreateVolumesFromImageTest-1765526579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:04:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c7382dd6-aed4-4789-a86b-1bc0546203f3 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c7382dd6-aed4-4789-a86b-1bc0546203f3 tempest-CreateVolumesFromImageTest-1765526579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:53 devstack sudo[105088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:04:53 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:53 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c7382dd6-aed4-4789-a86b-1bc0546203f3 tempest-CreateVolumesFromImageTest-1765526579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.343s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:53 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-c7382dd6-aed4-4789-a86b-1bc0546203f3 tempest-CreateVolumesFromImageTest-1765526579 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:04:53 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-c7382dd6-aed4-4789-a86b-1bc0546203f3 tempest-CreateVolumesFromImageTest-1765526579 None] Deleted volume successfully.
Sep 04 16:04:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c7382dd6-aed4-4789-a86b-1bc0546203f3 tempest-CreateVolumesFromImageTest-1765526579 None] Lock "cinder-4034060e-6da5-4bd6-b859-fcdbfc5fcf1c-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:04:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1c6a590e-5757-4128-b8a8-98dce420370a tempest-CreateVolumesFromImageTest-1765526579 None] Acquiring lock "cinder-ff990cc7-38fc-4e84-a1b5-ee67544552ed-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:04:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1c6a590e-5757-4128-b8a8-98dce420370a tempest-CreateVolumesFromImageTest-1765526579 None] Lock "cinder-ff990cc7-38fc-4e84-a1b5-ee67544552ed-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:04:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1c6a590e-5757-4128-b8a8-98dce420370a tempest-CreateVolumesFromImageTest-1765526579 None] Acquiring lock "cinder-quobyte-ff990cc7-38fc-4e84-a1b5-ee67544552ed" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:04:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1c6a590e-5757-4128-b8a8-98dce420370a tempest-CreateVolumesFromImageTest-1765526579 None] Lock "cinder-quobyte-ff990cc7-38fc-4e84-a1b5-ee67544552ed" acquired by "delete_volume" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:04:54 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f30b5c5-3b54-4dab-b513-08ef5d7be1a4]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:04:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1c6a590e-5757-4128-b8a8-98dce420370a tempest-CreateVolumesFromImageTest-1765526579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ff990cc7-38fc-4e84-a1b5-ee67544552ed {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:54 devstack sudo[105097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ff990cc7-38fc-4e84-a1b5-ee67544552ed
Sep 04 16:04:54 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:54 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-c8ac03c5-16d1-4d6f-b1d3-33bd4c2d5513 req-a3609a4d-38ce-4893-9bf0-b09418f3a9b0 tempest-TestShelveInstance-1989432834 None] Terminate volume connection completed successfully.
Sep 04 16:04:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-c8ac03c5-16d1-4d6f-b1d3-33bd4c2d5513 req-a3609a4d-38ce-4893-9bf0-b09418f3a9b0 tempest-TestShelveInstance-1989432834 None] Deleting attachment 7e269598-afd7-4bda-a7f8-67a06c6dd0f4. {{(pid=87504) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 16:04:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-c8ac03c5-16d1-4d6f-b1d3-33bd4c2d5513 req-2949a8ee-0e6b-4235-9b5f-b2a3dd814812 tempest-TestShelveInstance-1989432834 None] Acquiring lock "cinder-ba75d1c8-37db-4a1d-817f-9aa6fa964683-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:04:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-c8ac03c5-16d1-4d6f-b1d3-33bd4c2d5513 req-2949a8ee-0e6b-4235-9b5f-b2a3dd814812 tempest-TestShelveInstance-1989432834 None] Lock "cinder-ba75d1c8-37db-4a1d-817f-9aa6fa964683-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:04:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-c8ac03c5-16d1-4d6f-b1d3-33bd4c2d5513 req-2949a8ee-0e6b-4235-9b5f-b2a3dd814812 tempest-TestShelveInstance-1989432834 None] Acquiring lock "cinder-quobyte-ba75d1c8-37db-4a1d-817f-9aa6fa964683" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:04:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-c8ac03c5-16d1-4d6f-b1d3-33bd4c2d5513 req-2949a8ee-0e6b-4235-9b5f-b2a3dd814812 tempest-TestShelveInstance-1989432834 None] Lock "cinder-quobyte-ba75d1c8-37db-4a1d-817f-9aa6fa964683" acquired by "delete_volume" :: waited 0.022s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:04:54 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b944a0-0a64-43e2-97e4-4f649e256996]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:04:54 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-c8ac03c5-16d1-4d6f-b1d3-33bd4c2d5513 req-2949a8ee-0e6b-4235-9b5f-b2a3dd814812 tempest-TestShelveInstance-1989432834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ba75d1c8-37db-4a1d-817f-9aa6fa964683 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1c6a590e-5757-4128-b8a8-98dce420370a tempest-CreateVolumesFromImageTest-1765526579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ff990cc7-38fc-4e84-a1b5-ee67544552ed" returned: 0 in 0.548s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1c6a590e-5757-4128-b8a8-98dce420370a tempest-CreateVolumesFromImageTest-1765526579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ff990cc7-38fc-4e84-a1b5-ee67544552ed {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:54 devstack sudo[105104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ff990cc7-38fc-4e84-a1b5-ee67544552ed
Sep 04 16:04:54 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:54 devstack sudo[105103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ba75d1c8-37db-4a1d-817f-9aa6fa964683
Sep 04 16:04:54 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:54 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1c6a590e-5757-4128-b8a8-98dce420370a tempest-CreateVolumesFromImageTest-1765526579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ff990cc7-38fc-4e84-a1b5-ee67544552ed" returned: 0 in 0.416s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1c6a590e-5757-4128-b8a8-98dce420370a tempest-CreateVolumesFromImageTest-1765526579 None] Lock "cinder-quobyte-ff990cc7-38fc-4e84-a1b5-ee67544552ed" released by "delete_volume" :: held 1.036s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:04:55 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-1c6a590e-5757-4128-b8a8-98dce420370a tempest-CreateVolumesFromImageTest-1765526579 None] Created reservations ['4d017548-0a92-431e-a516-68320a963774', '42a713ca-a11c-4adb-bb90-2fc8a3bb7376', 'ce7fcbb5-359a-48cf-af94-5b8e966c7f32', '67743c2c-4494-4257-8ec5-fe270405f730'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:04:55 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-c8ac03c5-16d1-4d6f-b1d3-33bd4c2d5513 req-2949a8ee-0e6b-4235-9b5f-b2a3dd814812 tempest-TestShelveInstance-1989432834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ba75d1c8-37db-4a1d-817f-9aa6fa964683" returned: 0 in 0.666s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-c8ac03c5-16d1-4d6f-b1d3-33bd4c2d5513 req-2949a8ee-0e6b-4235-9b5f-b2a3dd814812 tempest-TestShelveInstance-1989432834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ba75d1c8-37db-4a1d-817f-9aa6fa964683 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:55 devstack sudo[105113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ba75d1c8-37db-4a1d-817f-9aa6fa964683
Sep 04 16:04:55 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1c6a590e-5757-4128-b8a8-98dce420370a tempest-CreateVolumesFromImageTest-1765526579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1c6a590e-5757-4128-b8a8-98dce420370a tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1c6a590e-5757-4128-b8a8-98dce420370a tempest-CreateVolumesFromImageTest-1765526579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:04:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1c6a590e-5757-4128-b8a8-98dce420370a tempest-CreateVolumesFromImageTest-1765526579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:04:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1c6a590e-5757-4128-b8a8-98dce420370a tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1c6a590e-5757-4128-b8a8-98dce420370a tempest-CreateVolumesFromImageTest-1765526579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:55 devstack sudo[105115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:04:55 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:55 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-c8ac03c5-16d1-4d6f-b1d3-33bd4c2d5513 req-2949a8ee-0e6b-4235-9b5f-b2a3dd814812 tempest-TestShelveInstance-1989432834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ba75d1c8-37db-4a1d-817f-9aa6fa964683" returned: 0 in 0.286s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-c8ac03c5-16d1-4d6f-b1d3-33bd4c2d5513 req-2949a8ee-0e6b-4235-9b5f-b2a3dd814812 tempest-TestShelveInstance-1989432834 None] Lock "cinder-quobyte-ba75d1c8-37db-4a1d-817f-9aa6fa964683" released by "delete_volume" :: held 1.013s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:04:55 devstack cinder-volume[87504]: DEBUG cinder.quota [req-c8ac03c5-16d1-4d6f-b1d3-33bd4c2d5513 req-2949a8ee-0e6b-4235-9b5f-b2a3dd814812 tempest-TestShelveInstance-1989432834 None] Created reservations ['10ef6fce-832b-47df-8edc-2355c630cfa3', 'fe950fc5-66b9-44b9-ad3b-d0927de62ca7', '2a252d7d-2240-47b7-aecd-54e7b7344ff5', '0584d8e2-9270-45e1-8bf2-35f9f7ea62ae'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:04:55 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1c6a590e-5757-4128-b8a8-98dce420370a tempest-CreateVolumesFromImageTest-1765526579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.311s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:55 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-1c6a590e-5757-4128-b8a8-98dce420370a tempest-CreateVolumesFromImageTest-1765526579 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:04:55 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-1c6a590e-5757-4128-b8a8-98dce420370a tempest-CreateVolumesFromImageTest-1765526579 None] Deleted volume successfully.
Sep 04 16:04:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1c6a590e-5757-4128-b8a8-98dce420370a tempest-CreateVolumesFromImageTest-1765526579 None] Lock "cinder-ff990cc7-38fc-4e84-a1b5-ee67544552ed-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:04:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-c8ac03c5-16d1-4d6f-b1d3-33bd4c2d5513 req-2949a8ee-0e6b-4235-9b5f-b2a3dd814812 tempest-TestShelveInstance-1989432834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-c8ac03c5-16d1-4d6f-b1d3-33bd4c2d5513 req-2949a8ee-0e6b-4235-9b5f-b2a3dd814812 tempest-TestShelveInstance-1989432834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [req-c8ac03c5-16d1-4d6f-b1d3-33bd4c2d5513 req-2949a8ee-0e6b-4235-9b5f-b2a3dd814812 tempest-TestShelveInstance-1989432834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:04:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [req-c8ac03c5-16d1-4d6f-b1d3-33bd4c2d5513 req-2949a8ee-0e6b-4235-9b5f-b2a3dd814812 tempest-TestShelveInstance-1989432834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:04:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-c8ac03c5-16d1-4d6f-b1d3-33bd4c2d5513 req-2949a8ee-0e6b-4235-9b5f-b2a3dd814812 tempest-TestShelveInstance-1989432834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-c8ac03c5-16d1-4d6f-b1d3-33bd4c2d5513 req-2949a8ee-0e6b-4235-9b5f-b2a3dd814812 tempest-TestShelveInstance-1989432834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:55 devstack sudo[105124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:04:55 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:56 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [req-c8ac03c5-16d1-4d6f-b1d3-33bd4c2d5513 req-2949a8ee-0e6b-4235-9b5f-b2a3dd814812 tempest-TestShelveInstance-1989432834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.302s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:56 devstack cinder-volume[87504]: DEBUG cinder.manager [req-c8ac03c5-16d1-4d6f-b1d3-33bd4c2d5513 req-2949a8ee-0e6b-4235-9b5f-b2a3dd814812 tempest-TestShelveInstance-1989432834 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:04:56 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-c8ac03c5-16d1-4d6f-b1d3-33bd4c2d5513 req-2949a8ee-0e6b-4235-9b5f-b2a3dd814812 tempest-TestShelveInstance-1989432834 None] Deleted volume successfully.
Sep 04 16:04:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [req-c8ac03c5-16d1-4d6f-b1d3-33bd4c2d5513 req-2949a8ee-0e6b-4235-9b5f-b2a3dd814812 tempest-TestShelveInstance-1989432834 None] Lock "cinder-ba75d1c8-37db-4a1d-817f-9aa6fa964683-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:04:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dc6a67c7-c9ee-4033-9053-28e44d143c2b tempest-CreateVolumesFromImageTest-1765526579 None] Acquiring lock "cinder-6fd7b8aa-193f-4a62-9a2d-041e0ad1b773-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:04:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dc6a67c7-c9ee-4033-9053-28e44d143c2b tempest-CreateVolumesFromImageTest-1765526579 None] Lock "cinder-6fd7b8aa-193f-4a62-9a2d-041e0ad1b773-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:04:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dc6a67c7-c9ee-4033-9053-28e44d143c2b tempest-CreateVolumesFromImageTest-1765526579 None] Acquiring lock "cinder-quobyte-6fd7b8aa-193f-4a62-9a2d-041e0ad1b773" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:04:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dc6a67c7-c9ee-4033-9053-28e44d143c2b tempest-CreateVolumesFromImageTest-1765526579 None] Lock "cinder-quobyte-6fd7b8aa-193f-4a62-9a2d-041e0ad1b773" acquired by "delete_volume" :: waited 0.034s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:04:56 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9e0d16-28c9-4ea5-8650-73dd2355534d]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:04:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc6a67c7-c9ee-4033-9053-28e44d143c2b tempest-CreateVolumesFromImageTest-1765526579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6fd7b8aa-193f-4a62-9a2d-041e0ad1b773 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-559b00d1-06fd-4c67-8f08-71e5ab9ef8b6 req-d845e9b6-0421-44a4-ab1e-ba0a1216176c tempest-TestInstancesWithCinderVolumes-717012801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-559b00d1-06fd-4c67-8f08-71e5ab9ef8b6 req-d845e9b6-0421-44a4-ab1e-ba0a1216176c tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-559b00d1-06fd-4c67-8f08-71e5ab9ef8b6 req-d845e9b6-0421-44a4-ab1e-ba0a1216176c tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:56 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-559b00d1-06fd-4c67-8f08-71e5ab9ef8b6 req-d845e9b6-0421-44a4-ab1e-ba0a1216176c tempest-TestInstancesWithCinderVolumes-717012801 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236', 'name': 'volume-9a8240f2-725a-466c-bd2f-34075aced640', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75e2a6b6-8aaa-4ea0-b3c2-0856aed53167', 'enforce_multipath': True} {{(pid=87504) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 16:04:56 devstack sudo[105135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6fd7b8aa-193f-4a62-9a2d-041e0ad1b773
Sep 04 16:04:56 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:56 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-559b00d1-06fd-4c67-8f08-71e5ab9ef8b6 req-d845e9b6-0421-44a4-ab1e-ba0a1216176c tempest-TestInstancesWithCinderVolumes-717012801 None] attachment_update completed successfully.
Sep 04 16:04:56 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc6a67c7-c9ee-4033-9053-28e44d143c2b tempest-CreateVolumesFromImageTest-1765526579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6fd7b8aa-193f-4a62-9a2d-041e0ad1b773" returned: 0 in 0.454s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc6a67c7-c9ee-4033-9053-28e44d143c2b tempest-CreateVolumesFromImageTest-1765526579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6fd7b8aa-193f-4a62-9a2d-041e0ad1b773 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:56 devstack sudo[105142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6fd7b8aa-193f-4a62-9a2d-041e0ad1b773
Sep 04 16:04:56 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:57 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc6a67c7-c9ee-4033-9053-28e44d143c2b tempest-CreateVolumesFromImageTest-1765526579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6fd7b8aa-193f-4a62-9a2d-041e0ad1b773" returned: 0 in 0.296s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dc6a67c7-c9ee-4033-9053-28e44d143c2b tempest-CreateVolumesFromImageTest-1765526579 None] Lock "cinder-quobyte-6fd7b8aa-193f-4a62-9a2d-041e0ad1b773" released by "delete_volume" :: held 0.803s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:04:57 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-dc6a67c7-c9ee-4033-9053-28e44d143c2b tempest-CreateVolumesFromImageTest-1765526579 None] Created reservations ['7a106f0d-eace-47ea-bbe8-e2c1b9ae979f', '069ffcf8-ab58-4b6e-8e3a-b5da4e378617', '26e6ae41-ec61-4a25-83ac-1130d1269c8f', '48c3afb2-756a-452a-b754-0fff700f9e01'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:04:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-dc6a67c7-c9ee-4033-9053-28e44d143c2b tempest-CreateVolumesFromImageTest-1765526579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-dc6a67c7-c9ee-4033-9053-28e44d143c2b tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:57 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-dc6a67c7-c9ee-4033-9053-28e44d143c2b tempest-CreateVolumesFromImageTest-1765526579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:04:57 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-dc6a67c7-c9ee-4033-9053-28e44d143c2b tempest-CreateVolumesFromImageTest-1765526579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:04:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-dc6a67c7-c9ee-4033-9053-28e44d143c2b tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc6a67c7-c9ee-4033-9053-28e44d143c2b tempest-CreateVolumesFromImageTest-1765526579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:57 devstack sudo[105145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:04:57 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5e612030-d4da-4c4c-8d00-b8eb54d3f89e tempest-CreateVolumesFromImageTest-1765526579 None] Acquiring lock "cinder-b4141d28-bb8b-4141-a15b-1405f86b7d31-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:04:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5e612030-d4da-4c4c-8d00-b8eb54d3f89e tempest-CreateVolumesFromImageTest-1765526579 None] Lock "cinder-b4141d28-bb8b-4141-a15b-1405f86b7d31-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:04:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5e612030-d4da-4c4c-8d00-b8eb54d3f89e tempest-CreateVolumesFromImageTest-1765526579 None] Acquiring lock "cinder-quobyte-b4141d28-bb8b-4141-a15b-1405f86b7d31" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:04:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5e612030-d4da-4c4c-8d00-b8eb54d3f89e tempest-CreateVolumesFromImageTest-1765526579 None] Lock "cinder-quobyte-b4141d28-bb8b-4141-a15b-1405f86b7d31" acquired by "delete_volume" :: waited 0.033s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:04:57 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa52313-d797-446f-89fc-2f493e7760f8]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:04:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5e612030-d4da-4c4c-8d00-b8eb54d3f89e tempest-CreateVolumesFromImageTest-1765526579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b4141d28-bb8b-4141-a15b-1405f86b7d31 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:57 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc6a67c7-c9ee-4033-9053-28e44d143c2b tempest-CreateVolumesFromImageTest-1765526579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.314s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:57 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-dc6a67c7-c9ee-4033-9053-28e44d143c2b tempest-CreateVolumesFromImageTest-1765526579 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:04:57 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-dc6a67c7-c9ee-4033-9053-28e44d143c2b tempest-CreateVolumesFromImageTest-1765526579 None] Deleted volume successfully.
Sep 04 16:04:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dc6a67c7-c9ee-4033-9053-28e44d143c2b tempest-CreateVolumesFromImageTest-1765526579 None] Lock "cinder-6fd7b8aa-193f-4a62-9a2d-041e0ad1b773-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:04:57 devstack sudo[105148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b4141d28-bb8b-4141-a15b-1405f86b7d31
Sep 04 16:04:57 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:58 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5e612030-d4da-4c4c-8d00-b8eb54d3f89e tempest-CreateVolumesFromImageTest-1765526579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b4141d28-bb8b-4141-a15b-1405f86b7d31" returned: 0 in 0.434s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5e612030-d4da-4c4c-8d00-b8eb54d3f89e tempest-CreateVolumesFromImageTest-1765526579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b4141d28-bb8b-4141-a15b-1405f86b7d31 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:58 devstack sudo[105153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b4141d28-bb8b-4141-a15b-1405f86b7d31
Sep 04 16:04:58 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5e612030-d4da-4c4c-8d00-b8eb54d3f89e tempest-CreateVolumesFromImageTest-1765526579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b4141d28-bb8b-4141-a15b-1405f86b7d31" returned: 0 in 0.301s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:58 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:58 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5e612030-d4da-4c4c-8d00-b8eb54d3f89e tempest-CreateVolumesFromImageTest-1765526579 None] Lock "cinder-quobyte-b4141d28-bb8b-4141-a15b-1405f86b7d31" released by "delete_volume" :: held 0.813s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:04:58 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-5e612030-d4da-4c4c-8d00-b8eb54d3f89e tempest-CreateVolumesFromImageTest-1765526579 None] Created reservations ['89061187-79b4-418c-ad06-8bed9d686958', '2979a9c0-e33b-4aa4-9c0b-1b01db88bf3f', 'f78b04ce-b899-4de6-b7ea-13cca308529f', 'a318e9bd-e398-42bf-ba3a-e60e96c2399f'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:04:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5e612030-d4da-4c4c-8d00-b8eb54d3f89e tempest-CreateVolumesFromImageTest-1765526579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5e612030-d4da-4c4c-8d00-b8eb54d3f89e tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:58 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5e612030-d4da-4c4c-8d00-b8eb54d3f89e tempest-CreateVolumesFromImageTest-1765526579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:04:58 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5e612030-d4da-4c4c-8d00-b8eb54d3f89e tempest-CreateVolumesFromImageTest-1765526579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:04:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5e612030-d4da-4c4c-8d00-b8eb54d3f89e tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5e612030-d4da-4c4c-8d00-b8eb54d3f89e tempest-CreateVolumesFromImageTest-1765526579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:58 devstack sudo[105161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:04:58 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:58 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-09242eb8-36ed-4e59-beb7-20de83052faf tempest-CreateVolumesFromImageTest-1765526579 None] Acquiring lock "cinder-414230a4-3f29-415e-9282-816f2be0c91b-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:04:58 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-09242eb8-36ed-4e59-beb7-20de83052faf tempest-CreateVolumesFromImageTest-1765526579 None] Lock "cinder-414230a4-3f29-415e-9282-816f2be0c91b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:04:58 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-09242eb8-36ed-4e59-beb7-20de83052faf tempest-CreateVolumesFromImageTest-1765526579 None] Acquiring lock "cinder-quobyte-414230a4-3f29-415e-9282-816f2be0c91b" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:04:58 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-09242eb8-36ed-4e59-beb7-20de83052faf tempest-CreateVolumesFromImageTest-1765526579 None] Lock "cinder-quobyte-414230a4-3f29-415e-9282-816f2be0c91b" acquired by "delete_volume" :: waited 0.019s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:04:58 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[851ec3b8-42fc-4b41-9a06-ce132bd27f5b]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:04:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-09242eb8-36ed-4e59-beb7-20de83052faf tempest-CreateVolumesFromImageTest-1765526579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-414230a4-3f29-415e-9282-816f2be0c91b {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:58 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5e612030-d4da-4c4c-8d00-b8eb54d3f89e tempest-CreateVolumesFromImageTest-1765526579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.339s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:58 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-5e612030-d4da-4c4c-8d00-b8eb54d3f89e tempest-CreateVolumesFromImageTest-1765526579 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:04:58 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-5e612030-d4da-4c4c-8d00-b8eb54d3f89e tempest-CreateVolumesFromImageTest-1765526579 None] Deleted volume successfully.
Sep 04 16:04:58 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5e612030-d4da-4c4c-8d00-b8eb54d3f89e tempest-CreateVolumesFromImageTest-1765526579 None] Lock "cinder-b4141d28-bb8b-4141-a15b-1405f86b7d31-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:04:58 devstack sudo[105166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-414230a4-3f29-415e-9282-816f2be0c91b
Sep 04 16:04:58 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:59 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-09242eb8-36ed-4e59-beb7-20de83052faf tempest-CreateVolumesFromImageTest-1765526579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-414230a4-3f29-415e-9282-816f2be0c91b" returned: 0 in 0.415s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-09242eb8-36ed-4e59-beb7-20de83052faf tempest-CreateVolumesFromImageTest-1765526579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-414230a4-3f29-415e-9282-816f2be0c91b {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:59 devstack sudo[105175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-414230a4-3f29-415e-9282-816f2be0c91b
Sep 04 16:04:59 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:59 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root
Sep 04 16:04:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-09242eb8-36ed-4e59-beb7-20de83052faf tempest-CreateVolumesFromImageTest-1765526579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-414230a4-3f29-415e-9282-816f2be0c91b" returned: 0 in 0.269s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:04:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-09242eb8-36ed-4e59-beb7-20de83052faf tempest-CreateVolumesFromImageTest-1765526579 None] Lock "cinder-quobyte-414230a4-3f29-415e-9282-816f2be0c91b" released by "delete_volume" :: held 0.750s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:04:59 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-09242eb8-36ed-4e59-beb7-20de83052faf tempest-CreateVolumesFromImageTest-1765526579 None] Created reservations ['515b3a6d-d17c-4f9d-8f1d-77512df4f6f9', '4a823e47-9d8d-486c-ad56-6a9a671a882d', '98ff16da-8f91-456d-b94a-10e3500505f5', '314256f8-f7c2-4057-95c5-d868c10c130f'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:04:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-09242eb8-36ed-4e59-beb7-20de83052faf tempest-CreateVolumesFromImageTest-1765526579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-09242eb8-36ed-4e59-beb7-20de83052faf tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-09242eb8-36ed-4e59-beb7-20de83052faf tempest-CreateVolumesFromImageTest-1765526579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:04:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-09242eb8-36ed-4e59-beb7-20de83052faf tempest-CreateVolumesFromImageTest-1765526579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:04:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-09242eb8-36ed-4e59-beb7-20de83052faf tempest-CreateVolumesFromImageTest-1765526579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:04:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-09242eb8-36ed-4e59-beb7-20de83052faf tempest-CreateVolumesFromImageTest-1765526579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:04:59 devstack sudo[105186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:04:59 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:04:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-7df6d221-24f2-40c5-804e-c44b1d613c73 req-fa8cb567-5441-471c-9c50-8dc44ac1573c tempest-TestInstancesWithCinderVolumes-717012801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:04:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-7df6d221-24f2-40c5-804e-c44b1d613c73 req-fa8cb567-5441-471c-9c50-8dc44ac1573c tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:04:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-7df6d221-24f2-40c5-804e-c44b1d613c73 req-fa8cb567-5441-471c-9c50-8dc44ac1573c tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-7df6d221-24f2-40c5-804e-c44b1d613c73 req-fa8cb567-5441-471c-9c50-8dc44ac1573c tempest-TestInstancesWithCinderVolumes-717012801 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236', 'name': 'volume-7f9edf9a-0634-4194-8aa1-2d3837c18d67', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11b59c1b-ed95-4d08-8ff4-7b503952bee4', 'enforce_multipath': True} {{(pid=87504) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 16:05:00 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-09242eb8-36ed-4e59-beb7-20de83052faf tempest-CreateVolumesFromImageTest-1765526579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.376s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:00 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-09242eb8-36ed-4e59-beb7-20de83052faf tempest-CreateVolumesFromImageTest-1765526579 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:05:00 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-09242eb8-36ed-4e59-beb7-20de83052faf tempest-CreateVolumesFromImageTest-1765526579 None] Deleted volume successfully.
Sep 04 16:05:00 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-7df6d221-24f2-40c5-804e-c44b1d613c73 req-fa8cb567-5441-471c-9c50-8dc44ac1573c tempest-TestInstancesWithCinderVolumes-717012801 None] attachment_update completed successfully.
Sep 04 16:05:00 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-09242eb8-36ed-4e59-beb7-20de83052faf tempest-CreateVolumesFromImageTest-1765526579 None] Lock "cinder-414230a4-3f29-415e-9282-816f2be0c91b-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:03 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:05:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Flow 'volume_create_manager' (3a9e21ba-8649-4258-9987-dd3d3692878e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7b0ab4-f763-429d-8afa-0074331f5f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7b0ab4-f763-429d-8afa-0074331f5f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2021854765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38d371d-b888-4681-aa8b-f7172ec9af4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f79261b12a8c4d6aa002ca67545d3eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:03Z,use_quota=True,user_id='e3c454387f1240b6b65af93b0cd59408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d38e0bc6-032d-45f4-8f5c-a0967c989da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d38e0bc6-032d-45f4-8f5c-a0967c989da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd8bf2f-4b36-4d89-8859-7039f7b952cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd8bf2f-4b36-4d89-8859-7039f7b952cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f38d371d-b888-4681-aa8b-f7172ec9af4f', 'volume_name': 'volume-f38d371d-b888-4681-aa8b-f7172ec9af4f', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfabd000-a686-4a94-bfa5-3f8d5d32ba1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfabd000-a686-4a94-bfa5-3f8d5d32ba1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e144e83f-9917-4a3d-8c7c-2973dd39b7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:03 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Volume f38d371d-b888-4681-aa8b-f7172ec9af4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f38d371d-b888-4681-aa8b-f7172ec9af4f', 'volume_size': 1}
Sep 04 16:05:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:03 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2021854765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38d371d-b888-4681-aa8b-f7172ec9af4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f79261b12a8c4d6aa002ca67545d3eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:03Z,use_quota=True,user_id='e3c454387f1240b6b65af93b0cd59408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:05:03 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Creating volume f38d371d-b888-4681-aa8b-f7172ec9af4f {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:05:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:03 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:03 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:03 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:05:03 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:05:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:03 devstack sudo[105203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f 1073741824
Sep 04 16:05:03 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:03 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f 1073741824" returned: 0 in 0.492s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:03 devstack sudo[105210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f
Sep 04 16:05:03 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:04 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f" returned: 0 in 0.274s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:04 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:05:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e144e83f-9917-4a3d-8c7c-2973dd39b7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f38d371d-b888-4681-aa8b-f7172ec9af4f', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906bac49-e2f8-47ef-b20c-90627e045796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:04 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Volume volume-f38d371d-b888-4681-aa8b-f7172ec9af4f (f38d371d-b888-4681-aa8b-f7172ec9af4f): created successfully
Sep 04 16:05:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906bac49-e2f8-47ef-b20c-90627e045796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Flow 'volume_create_manager' (3a9e21ba-8649-4258-9987-dd3d3692878e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:04 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-5808e4c8-5add-45de-872b-d39376fd3503 tempest-CreateVolumesFromSnapshotTest-55027921 None] Created volume successfully.
Sep 04 16:05:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-dc50d34a-5242-4aef-94ec-39d62709beba tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-dc50d34a-5242-4aef-94ec-39d62709beba tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-dc50d34a-5242-4aef-94ec-39d62709beba tempest-CreateVolumesFromSnapshotTest-55027921 None] Creating offline snapshot 5cd33b25-31cf-480b-82a3-a6c14c6d97ed of volume f38d371d-b888-4681-aa8b-f7172ec9af4f {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 16:05:05 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd39bb5-ffe1-48b9-ad3e-97987b2002b1]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:05:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc50d34a-5242-4aef-94ec-39d62709beba tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:05 devstack sudo[105237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f
Sep 04 16:05:05 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:06 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-fb07e7a0-26c6-48d4-9fc4-121f56938ff9 req-8099baad-daff-47c8-a904-003208c22b15 tempest-TestInstancesWithCinderVolumes-717012801 None] Terminate volume connection completed successfully.
Sep 04 16:05:06 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-fb07e7a0-26c6-48d4-9fc4-121f56938ff9 req-8099baad-daff-47c8-a904-003208c22b15 tempest-TestInstancesWithCinderVolumes-717012801 None] Deleting attachment 75e2a6b6-8aaa-4ea0-b3c2-0856aed53167. {{(pid=87504) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 16:05:06 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc50d34a-5242-4aef-94ec-39d62709beba tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f" returned: 0 in 0.513s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc50d34a-5242-4aef-94ec-39d62709beba tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.5cd33b25-31cf-480b-82a3-a6c14c6d97ed 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:06 devstack sudo[105244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.5cd33b25-31cf-480b-82a3-a6c14c6d97ed 1G
Sep 04 16:05:06 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:06 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc50d34a-5242-4aef-94ec-39d62709beba tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.5cd33b25-31cf-480b-82a3-a6c14c6d97ed 1G" returned: 0 in 0.476s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc50d34a-5242-4aef-94ec-39d62709beba tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f38d371d-b888-4681-aa8b-f7172ec9af4f -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.5cd33b25-31cf-480b-82a3-a6c14c6d97ed {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:06 devstack sudo[105285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f38d371d-b888-4681-aa8b-f7172ec9af4f -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.5cd33b25-31cf-480b-82a3-a6c14c6d97ed
Sep 04 16:05:06 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7d66854c-2093-4137-8392-207592ee0ba2 tempest-TestInstancesWithCinderVolumes-717012801 None] Acquiring lock "cinder-9a8240f2-725a-466c-bd2f-34075aced640-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7d66854c-2093-4137-8392-207592ee0ba2 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "cinder-9a8240f2-725a-466c-bd2f-34075aced640-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:07 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7d66854c-2093-4137-8392-207592ee0ba2 tempest-TestInstancesWithCinderVolumes-717012801 None] Acquiring lock "cinder-quobyte-9a8240f2-725a-466c-bd2f-34075aced640" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:07 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7d66854c-2093-4137-8392-207592ee0ba2 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "cinder-quobyte-9a8240f2-725a-466c-bd2f-34075aced640" acquired by "delete_volume" :: waited 0.025s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:07 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab2bc7c-df9b-4a83-ae47-68ed1ccab8ce]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:05:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7d66854c-2093-4137-8392-207592ee0ba2 tempest-TestInstancesWithCinderVolumes-717012801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9a8240f2-725a-466c-bd2f-34075aced640 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:07 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc50d34a-5242-4aef-94ec-39d62709beba tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f38d371d-b888-4681-aa8b-f7172ec9af4f -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.5cd33b25-31cf-480b-82a3-a6c14c6d97ed" returned: 0 in 0.464s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:07 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-dc50d34a-5242-4aef-94ec-39d62709beba tempest-CreateVolumesFromSnapshotTest-55027921 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.5cd33b25-31cf-480b-82a3-a6c14c6d97ed is being set with open permissions: ugo+rw
Sep 04 16:05:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc50d34a-5242-4aef-94ec-39d62709beba tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.5cd33b25-31cf-480b-82a3-a6c14c6d97ed {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:07 devstack sudo[105297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.5cd33b25-31cf-480b-82a3-a6c14c6d97ed
Sep 04 16:05:07 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:07 devstack sudo[105295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9a8240f2-725a-466c-bd2f-34075aced640
Sep 04 16:05:07 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:07 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc50d34a-5242-4aef-94ec-39d62709beba tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.5cd33b25-31cf-480b-82a3-a6c14c6d97ed" returned: 0 in 0.277s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc50d34a-5242-4aef-94ec-39d62709beba tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:07 devstack sudo[105304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.info
Sep 04 16:05:07 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:07 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7d66854c-2093-4137-8392-207592ee0ba2 tempest-TestInstancesWithCinderVolumes-717012801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9a8240f2-725a-466c-bd2f-34075aced640" returned: 0 in 0.466s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7d66854c-2093-4137-8392-207592ee0ba2 tempest-TestInstancesWithCinderVolumes-717012801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9a8240f2-725a-466c-bd2f-34075aced640 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:07 devstack sudo[105306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9a8240f2-725a-466c-bd2f-34075aced640
Sep 04 16:05:07 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:07 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc50d34a-5242-4aef-94ec-39d62709beba tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.info" returned: 0 in 0.356s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:07 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-dc50d34a-5242-4aef-94ec-39d62709beba tempest-CreateVolumesFromSnapshotTest-55027921 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.info is being set with open permissions: ugo+rw
Sep 04 16:05:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc50d34a-5242-4aef-94ec-39d62709beba tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:07 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7d66854c-2093-4137-8392-207592ee0ba2 tempest-TestInstancesWithCinderVolumes-717012801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9a8240f2-725a-466c-bd2f-34075aced640" returned: 0 in 0.338s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:07 devstack sudo[105310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.info
Sep 04 16:05:07 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:07 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7d66854c-2093-4137-8392-207592ee0ba2 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "cinder-quobyte-9a8240f2-725a-466c-bd2f-34075aced640" released by "delete_volume" :: held 0.853s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:07 devstack cinder-volume[87504]: WARNING cinder.quota [None req-7d66854c-2093-4137-8392-207592ee0ba2 tempest-TestInstancesWithCinderVolumes-717012801 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-300454549-900828313 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-300454549-900828313, it is now deprecated. Please use the default quota class for default quota.
Sep 04 16:05:07 devstack cinder-volume[87504]: WARNING cinder.quota [None req-7d66854c-2093-4137-8392-207592ee0ba2 tempest-TestInstancesWithCinderVolumes-717012801 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-300454549-900828313 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-300454549-900828313, it is now deprecated. Please use the default quota class for default quota.
Sep 04 16:05:07 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-7d66854c-2093-4137-8392-207592ee0ba2 tempest-TestInstancesWithCinderVolumes-717012801 None] Created reservations ['7a6eaaaa-6ce3-4db6-a94f-c7f2c0e9c936', '6ae24e2c-a375-456c-b5a3-bb1288c329df', '49bcd84b-b9f6-49dc-93e8-c695f4811792', 'b8025c4d-6e85-43aa-bff0-9dda3d4694ae'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:05:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7d66854c-2093-4137-8392-207592ee0ba2 tempest-TestInstancesWithCinderVolumes-717012801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7d66854c-2093-4137-8392-207592ee0ba2 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7d66854c-2093-4137-8392-207592ee0ba2 tempest-TestInstancesWithCinderVolumes-717012801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7d66854c-2093-4137-8392-207592ee0ba2 tempest-TestInstancesWithCinderVolumes-717012801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7d66854c-2093-4137-8392-207592ee0ba2 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7d66854c-2093-4137-8392-207592ee0ba2 tempest-TestInstancesWithCinderVolumes-717012801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:08 devstack sudo[105312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:05:08 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:08 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc50d34a-5242-4aef-94ec-39d62709beba tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.info" returned: 0 in 0.307s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-dc50d34a-5242-4aef-94ec-39d62709beba tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.515s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:08 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-dc50d34a-5242-4aef-94ec-39d62709beba tempest-CreateVolumesFromSnapshotTest-55027921 None] Create snapshot completed successfully
Sep 04 16:05:08 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7d66854c-2093-4137-8392-207592ee0ba2 tempest-TestInstancesWithCinderVolumes-717012801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.322s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:08 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-7d66854c-2093-4137-8392-207592ee0ba2 tempest-TestInstancesWithCinderVolumes-717012801 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:05:08 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-7d66854c-2093-4137-8392-207592ee0ba2 tempest-TestInstancesWithCinderVolumes-717012801 None] Deleted volume successfully.
Sep 04 16:05:08 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7d66854c-2093-4137-8392-207592ee0ba2 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "cinder-9a8240f2-725a-466c-bd2f-34075aced640-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Flow 'volume_create_manager' (8a3cfa5e-5d0c-4422-8018-acc453fcc6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9a46c2-ea96-4511-ae1d-ec96d9961a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9a46c2-ea96-4511-ae1d-ec96d9961a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-825630957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1da7fc35-4bbd-49c1-86e3-21efbc66d97c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f79261b12a8c4d6aa002ca67545d3eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:09Z,use_quota=True,user_id='e3c454387f1240b6b65af93b0cd59408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f64a6a8d-614b-4afe-b3f5-234e08178fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f64a6a8d-614b-4afe-b3f5-234e08178fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c149e34e-f7cf-4e00-9aaf-0f145e423824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c149e34e-f7cf-4e00-9aaf-0f145e423824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1da7fc35-4bbd-49c1-86e3-21efbc66d97c', 'volume_name': 'volume-1da7fc35-4bbd-49c1-86e3-21efbc66d97c', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e73039aa-0b2a-4684-9614-2ad18b0e1451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e73039aa-0b2a-4684-9614-2ad18b0e1451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e017d6-b4e2-4a51-9a16-4340854346c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:09 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Volume 1da7fc35-4bbd-49c1-86e3-21efbc66d97c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1da7fc35-4bbd-49c1-86e3-21efbc66d97c', 'volume_size': 1}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-825630957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1da7fc35-4bbd-49c1-86e3-21efbc66d97c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f79261b12a8c4d6aa002ca67545d3eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:09Z,use_quota=True,user_id='e3c454387f1240b6b65af93b0cd59408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Creating volume 1da7fc35-4bbd-49c1-86e3-21efbc66d97c {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:05:09 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1da7fc35-4bbd-49c1-86e3-21efbc66d97c 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:09 devstack sudo[105323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1da7fc35-4bbd-49c1-86e3-21efbc66d97c 1073741824
Sep 04 16:05:09 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Flow 'volume_create_manager' (7ff2a0f2-fa7b-4f49-94a5-a8ad6e226713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9958a8f2-efd6-4f3b-ad7d-b4247993f178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9958a8f2-efd6-4f3b-ad7d-b4247993f178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1071560137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826dfa38-d762-46d2-ae40-c71fd3180926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f79261b12a8c4d6aa002ca67545d3eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:10Z,use_quota=True,user_id='e3c454387f1240b6b65af93b0cd59408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2566a060-9f09-485c-82bb-22d5cdaad0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2566a060-9f09-485c-82bb-22d5cdaad0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dbbdd4b-559b-4c7d-bed2-73123feea255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dbbdd4b-559b-4c7d-bed2-73123feea255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '826dfa38-d762-46d2-ae40-c71fd3180926', 'volume_name': 'volume-826dfa38-d762-46d2-ae40-c71fd3180926', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fdefaf9-24ae-4c41-9f5c-9b04c8fd6880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fdefaf9-24ae-4c41-9f5c-9b04c8fd6880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188df087-502d-40e6-906f-bbca24bca464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:10 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Volume 826dfa38-d762-46d2-ae40-c71fd3180926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-826dfa38-d762-46d2-ae40-c71fd3180926', 'volume_size': 1}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:10 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1da7fc35-4bbd-49c1-86e3-21efbc66d97c 1073741824" returned: 0 in 0.579s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1da7fc35-4bbd-49c1-86e3-21efbc66d97c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:10 devstack sudo[105341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1da7fc35-4bbd-49c1-86e3-21efbc66d97c
Sep 04 16:05:10 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:10 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1da7fc35-4bbd-49c1-86e3-21efbc66d97c" returned: 0 in 0.353s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.438s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1071560137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826dfa38-d762-46d2-ae40-c71fd3180926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f79261b12a8c4d6aa002ca67545d3eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:10Z,use_quota=True,user_id='e3c454387f1240b6b65af93b0cd59408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Creating volume 826dfa38-d762-46d2-ae40-c71fd3180926 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:05:10 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-826dfa38-d762-46d2-ae40-c71fd3180926 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:05:10 devstack sudo[105346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-826dfa38-d762-46d2-ae40-c71fd3180926 1073741824
Sep 04 16:05:10 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Flow 'volume_create_manager' (24297227-aec8-4a6e-ba30-d2631ecd66af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5803ea-5f71-4014-bb2d-9a63d93ce67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e017d6-b4e2-4a51-9a16-4340854346c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1da7fc35-4bbd-49c1-86e3-21efbc66d97c', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a479c5-4a23-452f-be2c-d0e3c3c5c52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5803ea-5f71-4014-bb2d-9a63d93ce67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1584121016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f66b33-9565-4aaa-bc80-63d9a21c0709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f79261b12a8c4d6aa002ca67545d3eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:10Z,use_quota=True,user_id='e3c454387f1240b6b65af93b0cd59408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2377c2f5-c6a6-4568-8d60-aeacd1a84ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2377c2f5-c6a6-4568-8d60-aeacd1a84ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70601ce8-4559-4dff-ba39-4b1e8fb971e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70601ce8-4559-4dff-ba39-4b1e8fb971e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7f66b33-9565-4aaa-bc80-63d9a21c0709', 'volume_name': 'volume-e7f66b33-9565-4aaa-bc80-63d9a21c0709', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206d3975-7bd5-46ef-b7d3-ad13005f3c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206d3975-7bd5-46ef-b7d3-ad13005f3c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f4af70-e4fd-4d1f-b246-90abf7c225ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:10 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Volume e7f66b33-9565-4aaa-bc80-63d9a21c0709: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7f66b33-9565-4aaa-bc80-63d9a21c0709', 'volume_size': 1}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:10 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Volume volume-1da7fc35-4bbd-49c1-86e3-21efbc66d97c (1da7fc35-4bbd-49c1-86e3-21efbc66d97c): created successfully
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a479c5-4a23-452f-be2c-d0e3c3c5c52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Flow 'volume_create_manager' (8a3cfa5e-5d0c-4422-8018-acc453fcc6fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:10 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-245b14a9-3a4a-4c0f-9f5e-f3e33af894a9 tempest-CreateVolumesFromSnapshotTest-55027921 None] Created volume successfully.
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Flow 'volume_create_manager' (cc922d62-3459-4a8c-9af4-c497a3968b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e80798e-b8c5-436c-9faa-872bb1460808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e80798e-b8c5-436c-9faa-872bb1460808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-946646748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=681d355d-83ee-4040-a996-0d2515d684af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f79261b12a8c4d6aa002ca67545d3eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:11Z,use_quota=True,user_id='e3c454387f1240b6b65af93b0cd59408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909c2f75-4b09-4028-98ce-04f7ed2cc95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909c2f75-4b09-4028-98ce-04f7ed2cc95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfdc1461-0860-41be-8947-cd58bb401657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfdc1461-0860-41be-8947-cd58bb401657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '681d355d-83ee-4040-a996-0d2515d684af', 'volume_name': 'volume-681d355d-83ee-4040-a996-0d2515d684af', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0167ac9e-6602-4e7a-b134-026f7b4de801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0167ac9e-6602-4e7a-b134-026f7b4de801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (598cbf73-90f6-4458-b9cb-603f3df103f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:11 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Volume 681d355d-83ee-4040-a996-0d2515d684af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-681d355d-83ee-4040-a996-0d2515d684af', 'volume_size': 1}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:11 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-826dfa38-d762-46d2-ae40-c71fd3180926 1073741824" returned: 0 in 0.812s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:11 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-fa244ae0-08c8-4f40-8225-43bf0c302de9 req-503d2647-4d18-4ee4-a906-96a8b622613d tempest-TestInstancesWithCinderVolumes-717012801 None] Terminate volume connection completed successfully.
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-fa244ae0-08c8-4f40-8225-43bf0c302de9 req-503d2647-4d18-4ee4-a906-96a8b622613d tempest-TestInstancesWithCinderVolumes-717012801 None] Deleting attachment 11b59c1b-ed95-4d08-8ff4-7b503952bee4. {{(pid=87504) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-826dfa38-d762-46d2-ae40-c71fd3180926 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:11 devstack sudo[105354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-826dfa38-d762-46d2-ae40-c71fd3180926
Sep 04 16:05:11 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Flow 'volume_create_manager' (6579e001-3a5e-4bd5-bed7-5ab8a95dcd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a1317e-39b2-4bf6-8d07-56f2385e7999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a1317e-39b2-4bf6-8d07-56f2385e7999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-137596421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f79261b12a8c4d6aa002ca67545d3eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:11Z,use_quota=True,user_id='e3c454387f1240b6b65af93b0cd59408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f272e6c-8fdb-4057-b5a6-22d730d7bd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:11 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f272e6c-8fdb-4057-b5a6-22d730d7bd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae84a286-58d6-40da-857a-057460acee86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae84a286-58d6-40da-857a-057460acee86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad', 'volume_name': 'volume-f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1cae14c-7c18-4509-999b-e22d22ce9644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1cae14c-7c18-4509-999b-e22d22ce9644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c468f27-4f2c-44d4-8fef-4d721a5696a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:11 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Volume f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad', 'volume_size': 1}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-826dfa38-d762-46d2-ae40-c71fd3180926" returned: 0 in 0.360s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.024s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1584121016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f66b33-9565-4aaa-bc80-63d9a21c0709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f79261b12a8c4d6aa002ca67545d3eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:10Z,use_quota=True,user_id='e3c454387f1240b6b65af93b0cd59408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Creating volume e7f66b33-9565-4aaa-bc80-63d9a21c0709 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:05:11 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e7f66b33-9565-4aaa-bc80-63d9a21c0709 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188df087-502d-40e6-906f-bbca24bca464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-826dfa38-d762-46d2-ae40-c71fd3180926', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d459cff1-6e32-4bce-9e0b-2750983cafcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:11 devstack sudo[105357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e7f66b33-9565-4aaa-bc80-63d9a21c0709 1073741824
Sep 04 16:05:11 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:11 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Volume volume-826dfa38-d762-46d2-ae40-c71fd3180926 (826dfa38-d762-46d2-ae40-c71fd3180926): created successfully
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d459cff1-6e32-4bce-9e0b-2750983cafcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Flow 'volume_create_manager' (7ff2a0f2-fa7b-4f49-94a5-a8ad6e226713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:11 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-05cb3b5d-022b-4c97-9880-0a7fe7263370 tempest-CreateVolumesFromSnapshotTest-55027921 None] Created volume successfully.
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9161eb6f-63db-46d7-a4dd-cced8c02a69b tempest-TestInstancesWithCinderVolumes-717012801 None] Acquiring lock "cinder-7f9edf9a-0634-4194-8aa1-2d3837c18d67-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:11 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9161eb6f-63db-46d7-a4dd-cced8c02a69b tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "cinder-7f9edf9a-0634-4194-8aa1-2d3837c18d67-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9161eb6f-63db-46d7-a4dd-cced8c02a69b tempest-TestInstancesWithCinderVolumes-717012801 None] Acquiring lock "cinder-quobyte-7f9edf9a-0634-4194-8aa1-2d3837c18d67" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9161eb6f-63db-46d7-a4dd-cced8c02a69b tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "cinder-quobyte-7f9edf9a-0634-4194-8aa1-2d3837c18d67" acquired by "delete_volume" :: waited 0.016s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[29553e3e-2755-46d5-b8d6-99c12409c5a9]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9161eb6f-63db-46d7-a4dd-cced8c02a69b tempest-TestInstancesWithCinderVolumes-717012801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9edf9a-0634-4194-8aa1-2d3837c18d67 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:12 devstack sudo[105362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9edf9a-0634-4194-8aa1-2d3837c18d67
Sep 04 16:05:12 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:12 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e7f66b33-9565-4aaa-bc80-63d9a21c0709 1073741824" returned: 0 in 0.634s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e7f66b33-9565-4aaa-bc80-63d9a21c0709 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:12 devstack sudo[105365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e7f66b33-9565-4aaa-bc80-63d9a21c0709
Sep 04 16:05:12 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:12 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9161eb6f-63db-46d7-a4dd-cced8c02a69b tempest-TestInstancesWithCinderVolumes-717012801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9edf9a-0634-4194-8aa1-2d3837c18d67" returned: 0 in 0.512s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9161eb6f-63db-46d7-a4dd-cced8c02a69b tempest-TestInstancesWithCinderVolumes-717012801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9edf9a-0634-4194-8aa1-2d3837c18d67 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:12 devstack sudo[105370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9edf9a-0634-4194-8aa1-2d3837c18d67
Sep 04 16:05:12 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:12 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e7f66b33-9565-4aaa-bc80-63d9a21c0709" returned: 0 in 0.330s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.464s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-946646748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=681d355d-83ee-4040-a996-0d2515d684af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f79261b12a8c4d6aa002ca67545d3eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:11Z,use_quota=True,user_id='e3c454387f1240b6b65af93b0cd59408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Creating volume 681d355d-83ee-4040-a996-0d2515d684af {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:05:12 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-681d355d-83ee-4040-a996-0d2515d684af 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:12 devstack sudo[105373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-681d355d-83ee-4040-a996-0d2515d684af 1073741824
Sep 04 16:05:12 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f4af70-e4fd-4d1f-b246-90abf7c225ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7f66b33-9565-4aaa-bc80-63d9a21c0709', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9847307-0c1c-4508-a971-d73042b2a973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:12 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Volume volume-e7f66b33-9565-4aaa-bc80-63d9a21c0709 (e7f66b33-9565-4aaa-bc80-63d9a21c0709): created successfully
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9847307-0c1c-4508-a971-d73042b2a973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Flow 'volume_create_manager' (24297227-aec8-4a6e-ba30-d2631ecd66af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:12 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-adcf4327-f39b-46de-9968-783d5f111404 tempest-CreateVolumesFromSnapshotTest-55027921 None] Created volume successfully.
Sep 04 16:05:12 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9161eb6f-63db-46d7-a4dd-cced8c02a69b tempest-TestInstancesWithCinderVolumes-717012801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9edf9a-0634-4194-8aa1-2d3837c18d67" returned: 0 in 0.380s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:12 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9161eb6f-63db-46d7-a4dd-cced8c02a69b tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "cinder-quobyte-7f9edf9a-0634-4194-8aa1-2d3837c18d67" released by "delete_volume" :: held 0.937s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:13 devstack cinder-volume[87504]: WARNING cinder.quota [None req-9161eb6f-63db-46d7-a4dd-cced8c02a69b tempest-TestInstancesWithCinderVolumes-717012801 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1263612940-142170358 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1263612940-142170358, it is now deprecated. Please use the default quota class for default quota.
Sep 04 16:05:13 devstack cinder-volume[87504]: WARNING cinder.quota [None req-9161eb6f-63db-46d7-a4dd-cced8c02a69b tempest-TestInstancesWithCinderVolumes-717012801 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1263612940-142170358 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1263612940-142170358, it is now deprecated. Please use the default quota class for default quota.
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-9161eb6f-63db-46d7-a4dd-cced8c02a69b tempest-TestInstancesWithCinderVolumes-717012801 None] Created reservations ['06baf48c-0b55-494a-b333-106661cd52be', '1fa7c12e-8cac-4c65-9995-06cdf64d2e13', 'a822a2fc-7472-482f-8b12-fd46567ecf32', '5869b248-389c-416c-ac74-ba3904792850'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9161eb6f-63db-46d7-a4dd-cced8c02a69b tempest-TestInstancesWithCinderVolumes-717012801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9161eb6f-63db-46d7-a4dd-cced8c02a69b tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9161eb6f-63db-46d7-a4dd-cced8c02a69b tempest-TestInstancesWithCinderVolumes-717012801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9161eb6f-63db-46d7-a4dd-cced8c02a69b tempest-TestInstancesWithCinderVolumes-717012801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9161eb6f-63db-46d7-a4dd-cced8c02a69b tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9161eb6f-63db-46d7-a4dd-cced8c02a69b tempest-TestInstancesWithCinderVolumes-717012801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:13 devstack sudo[105379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:05:13 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:13 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-681d355d-83ee-4040-a996-0d2515d684af 1073741824" returned: 0 in 0.675s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-681d355d-83ee-4040-a996-0d2515d684af {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:13 devstack sudo[105383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-681d355d-83ee-4040-a996-0d2515d684af
Sep 04 16:05:13 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:13 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9161eb6f-63db-46d7-a4dd-cced8c02a69b tempest-TestInstancesWithCinderVolumes-717012801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.375s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-9161eb6f-63db-46d7-a4dd-cced8c02a69b tempest-TestInstancesWithCinderVolumes-717012801 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:05:13 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-9161eb6f-63db-46d7-a4dd-cced8c02a69b tempest-TestInstancesWithCinderVolumes-717012801 None] Deleted volume successfully.
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9161eb6f-63db-46d7-a4dd-cced8c02a69b tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "cinder-7f9edf9a-0634-4194-8aa1-2d3837c18d67-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:13 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-681d355d-83ee-4040-a996-0d2515d684af" returned: 0 in 0.289s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.090s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-137596421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f79261b12a8c4d6aa002ca67545d3eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:11Z,use_quota=True,user_id='e3c454387f1240b6b65af93b0cd59408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Creating volume f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:05:13 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:13 devstack sudo[105387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad 1073741824
Sep 04 16:05:13 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (598cbf73-90f6-4458-b9cb-603f3df103f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-681d355d-83ee-4040-a996-0d2515d684af', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0b8469-7b8e-40be-9330-83bde42aff1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:13 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Volume volume-681d355d-83ee-4040-a996-0d2515d684af (681d355d-83ee-4040-a996-0d2515d684af): created successfully
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0b8469-7b8e-40be-9330-83bde42aff1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Flow 'volume_create_manager' (cc922d62-3459-4a8c-9af4-c497a3968b08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:13 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-09b239b6-e86b-4b6b-9e86-d3b4196a534b tempest-CreateVolumesFromSnapshotTest-55027921 None] Created volume successfully.
Sep 04 16:05:14 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad 1073741824" returned: 0 in 0.662s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:14 devstack sudo[105394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad
Sep 04 16:05:14 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:14 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad" returned: 0 in 0.300s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:14 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:05:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:14 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c468f27-4f2c-44d4-8fef-4d721a5696a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:14 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb077fe-3b50-4d3e-9ef5-2fe74a31f844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:14 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Volume volume-f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad (f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad): created successfully
Sep 04 16:05:14 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb077fe-3b50-4d3e-9ef5-2fe74a31f844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:14 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Flow 'volume_create_manager' (6579e001-3a5e-4bd5-bed7-5ab8a95dcd24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:14 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f409d18d-cdc6-4609-bbb2-5073ca10f9e3 tempest-CreateVolumesFromSnapshotTest-55027921 None] Created volume successfully.
Sep 04 16:05:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-09456aa4-3af8-4f2b-8723-0d765db288b8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "cinder-f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-09456aa4-3af8-4f2b-8723-0d765db288b8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-09456aa4-3af8-4f2b-8723-0d765db288b8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "cinder-quobyte-f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-09456aa4-3af8-4f2b-8723-0d765db288b8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-quobyte-f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad" acquired by "delete_volume" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:15 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[521ce2e5-5f55-4039-b1df-6ae4545085a6]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:05:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-09456aa4-3af8-4f2b-8723-0d765db288b8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:15 devstack sudo[105400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad
Sep 04 16:05:15 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:16 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-09456aa4-3af8-4f2b-8723-0d765db288b8 tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad" returned: 0 in 0.724s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-09456aa4-3af8-4f2b-8723-0d765db288b8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:16 devstack sudo[105424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad
Sep 04 16:05:16 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:16 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-09456aa4-3af8-4f2b-8723-0d765db288b8 tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad" returned: 0 in 0.327s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-09456aa4-3af8-4f2b-8723-0d765db288b8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-quobyte-f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad" released by "delete_volume" :: held 1.119s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:16 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-09456aa4-3af8-4f2b-8723-0d765db288b8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Created reservations ['85c3cbba-52b8-4d21-886a-571f76bc7cb3', '60a96437-97b8-44c8-acbd-41bd7b71f299', '9449a6a0-46be-436b-8c3d-baefda0ded9b', '43742390-0240-4efa-b6f5-b87131406182'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:05:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-09456aa4-3af8-4f2b-8723-0d765db288b8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-09456aa4-3af8-4f2b-8723-0d765db288b8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-09456aa4-3af8-4f2b-8723-0d765db288b8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-09456aa4-3af8-4f2b-8723-0d765db288b8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-09456aa4-3af8-4f2b-8723-0d765db288b8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-09456aa4-3af8-4f2b-8723-0d765db288b8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:16 devstack sudo[105428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:05:16 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:17 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-c903234b-4d5f-49b8-8206-508499d64fa0 req-f133c419-afcd-4c89-b60b-88dcb3eaa2a6 tempest-TestInstancesWithCinderVolumes-717012801 None] Terminate volume connection completed successfully.
Sep 04 16:05:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-c903234b-4d5f-49b8-8206-508499d64fa0 req-f133c419-afcd-4c89-b60b-88dcb3eaa2a6 tempest-TestInstancesWithCinderVolumes-717012801 None] Deleting attachment 0a6375f7-a473-4332-8606-667a6cb9686f. {{(pid=87504) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 16:05:17 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-09456aa4-3af8-4f2b-8723-0d765db288b8 tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.330s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:17 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-09456aa4-3af8-4f2b-8723-0d765db288b8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:05:17 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-09456aa4-3af8-4f2b-8723-0d765db288b8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Deleted volume successfully.
Sep 04 16:05:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-09456aa4-3af8-4f2b-8723-0d765db288b8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-f3b97dcc-06fa-44ee-a8ab-c6f20003a3ad-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dad51433-67e4-48be-b23f-6613f63c739c tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "cinder-681d355d-83ee-4040-a996-0d2515d684af-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dad51433-67e4-48be-b23f-6613f63c739c tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-681d355d-83ee-4040-a996-0d2515d684af-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dad51433-67e4-48be-b23f-6613f63c739c tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "cinder-quobyte-681d355d-83ee-4040-a996-0d2515d684af" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dad51433-67e4-48be-b23f-6613f63c739c tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-quobyte-681d355d-83ee-4040-a996-0d2515d684af" acquired by "delete_volume" :: waited 0.025s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:17 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2b7998-b282-4af8-bebe-4a2754b37045]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:05:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dad51433-67e4-48be-b23f-6613f63c739c tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-681d355d-83ee-4040-a996-0d2515d684af {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:17 devstack sudo[105433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-681d355d-83ee-4040-a996-0d2515d684af
Sep 04 16:05:18 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:18 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dad51433-67e4-48be-b23f-6613f63c739c tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-681d355d-83ee-4040-a996-0d2515d684af" returned: 0 in 0.381s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dad51433-67e4-48be-b23f-6613f63c739c tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-681d355d-83ee-4040-a996-0d2515d684af {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:18 devstack sudo[105438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-681d355d-83ee-4040-a996-0d2515d684af
Sep 04 16:05:18 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:18 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2cf7643f-6541-48b4-ad1e-581e601dbce8 tempest-TestInstancesWithCinderVolumes-717012801 None] Acquiring lock "cinder-c803b736-e753-4380-b0fe-6555e14d23a2-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:18 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2cf7643f-6541-48b4-ad1e-581e601dbce8 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "cinder-c803b736-e753-4380-b0fe-6555e14d23a2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:18 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2cf7643f-6541-48b4-ad1e-581e601dbce8 tempest-TestInstancesWithCinderVolumes-717012801 None] Acquiring lock "cinder-quobyte-c803b736-e753-4380-b0fe-6555e14d23a2" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:18 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2cf7643f-6541-48b4-ad1e-581e601dbce8 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "cinder-quobyte-c803b736-e753-4380-b0fe-6555e14d23a2" acquired by "delete_volume" :: waited 0.054s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:18 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3f057c-8e14-4fa4-9252-2a8453f540dd]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:05:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2cf7643f-6541-48b4-ad1e-581e601dbce8 tempest-TestInstancesWithCinderVolumes-717012801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c803b736-e753-4380-b0fe-6555e14d23a2 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:18 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dad51433-67e4-48be-b23f-6613f63c739c tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-681d355d-83ee-4040-a996-0d2515d684af" returned: 0 in 0.393s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:18 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dad51433-67e4-48be-b23f-6613f63c739c tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-quobyte-681d355d-83ee-4040-a996-0d2515d684af" released by "delete_volume" :: held 0.844s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:18 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-dad51433-67e4-48be-b23f-6613f63c739c tempest-CreateVolumesFromSnapshotTest-55027921 None] Created reservations ['ea0ec714-b86d-40ac-a4fb-55e930749b28', '554a3414-a2b0-48dc-9c73-9297208c866f', '7a1480b1-92ad-4a3e-b434-8b8442efd0c8', '2bdbbaf4-2d9c-432c-b615-18416fa1224d'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:05:18 devstack sudo[105441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c803b736-e753-4380-b0fe-6555e14d23a2
Sep 04 16:05:18 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-dad51433-67e4-48be-b23f-6613f63c739c tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-dad51433-67e4-48be-b23f-6613f63c739c tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:18 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-dad51433-67e4-48be-b23f-6613f63c739c tempest-CreateVolumesFromSnapshotTest-55027921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:18 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-dad51433-67e4-48be-b23f-6613f63c739c tempest-CreateVolumesFromSnapshotTest-55027921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-dad51433-67e4-48be-b23f-6613f63c739c tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dad51433-67e4-48be-b23f-6613f63c739c tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:18 devstack sudo[105443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:05:18 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:18 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-6ca460df-bd37-4c40-b9ab-730470223ed8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "cinder-e7f66b33-9565-4aaa-bc80-63d9a21c0709-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-6ca460df-bd37-4c40-b9ab-730470223ed8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-e7f66b33-9565-4aaa-bc80-63d9a21c0709-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-6ca460df-bd37-4c40-b9ab-730470223ed8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "cinder-quobyte-e7f66b33-9565-4aaa-bc80-63d9a21c0709" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-6ca460df-bd37-4c40-b9ab-730470223ed8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-quobyte-e7f66b33-9565-4aaa-bc80-63d9a21c0709" acquired by "delete_volume" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:19 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a3be67-25dd-432f-9d90-b8c58e5d41fd]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:05:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6ca460df-bd37-4c40-b9ab-730470223ed8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e7f66b33-9565-4aaa-bc80-63d9a21c0709 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:19 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2cf7643f-6541-48b4-ad1e-581e601dbce8 tempest-TestInstancesWithCinderVolumes-717012801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c803b736-e753-4380-b0fe-6555e14d23a2" returned: 0 in 0.588s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2cf7643f-6541-48b4-ad1e-581e601dbce8 tempest-TestInstancesWithCinderVolumes-717012801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c803b736-e753-4380-b0fe-6555e14d23a2 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:19 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dad51433-67e4-48be-b23f-6613f63c739c tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.371s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:19 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-dad51433-67e4-48be-b23f-6613f63c739c tempest-CreateVolumesFromSnapshotTest-55027921 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:05:19 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-dad51433-67e4-48be-b23f-6613f63c739c tempest-CreateVolumesFromSnapshotTest-55027921 None] Deleted volume successfully.
Sep 04 16:05:19 devstack sudo[105451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c803b736-e753-4380-b0fe-6555e14d23a2
Sep 04 16:05:19 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dad51433-67e4-48be-b23f-6613f63c739c tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-681d355d-83ee-4040-a996-0d2515d684af-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:19 devstack sudo[105449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e7f66b33-9565-4aaa-bc80-63d9a21c0709
Sep 04 16:05:19 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:19 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2cf7643f-6541-48b4-ad1e-581e601dbce8 tempest-TestInstancesWithCinderVolumes-717012801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c803b736-e753-4380-b0fe-6555e14d23a2" returned: 0 in 0.295s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2cf7643f-6541-48b4-ad1e-581e601dbce8 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "cinder-quobyte-c803b736-e753-4380-b0fe-6555e14d23a2" released by "delete_volume" :: held 0.981s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:19 devstack cinder-volume[87504]: WARNING cinder.quota [None req-2cf7643f-6541-48b4-ad1e-581e601dbce8 tempest-TestInstancesWithCinderVolumes-717012801 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2131475033-989763004 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2131475033-989763004, it is now deprecated. Please use the default quota class for default quota.
Sep 04 16:05:19 devstack cinder-volume[87504]: WARNING cinder.quota [None req-2cf7643f-6541-48b4-ad1e-581e601dbce8 tempest-TestInstancesWithCinderVolumes-717012801 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2131475033-989763004 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2131475033-989763004, it is now deprecated. Please use the default quota class for default quota.
Sep 04 16:05:19 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-2cf7643f-6541-48b4-ad1e-581e601dbce8 tempest-TestInstancesWithCinderVolumes-717012801 None] Created reservations ['05fb8e2b-c515-4a6c-aa2e-63fa8e4741d1', '1a47c826-7c67-4bf7-a31c-4d47e8f9b688', '9fa766f9-3554-4c6c-9d82-ca8649a77148', 'a79702a9-9543-4945-860a-5e37fffc6f80'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:05:19 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6ca460df-bd37-4c40-b9ab-730470223ed8 tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e7f66b33-9565-4aaa-bc80-63d9a21c0709" returned: 0 in 0.534s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6ca460df-bd37-4c40-b9ab-730470223ed8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e7f66b33-9565-4aaa-bc80-63d9a21c0709 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2cf7643f-6541-48b4-ad1e-581e601dbce8 tempest-TestInstancesWithCinderVolumes-717012801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2cf7643f-6541-48b4-ad1e-581e601dbce8 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:19 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2cf7643f-6541-48b4-ad1e-581e601dbce8 tempest-TestInstancesWithCinderVolumes-717012801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:19 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2cf7643f-6541-48b4-ad1e-581e601dbce8 tempest-TestInstancesWithCinderVolumes-717012801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2cf7643f-6541-48b4-ad1e-581e601dbce8 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2cf7643f-6541-48b4-ad1e-581e601dbce8 tempest-TestInstancesWithCinderVolumes-717012801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:19 devstack sudo[105460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e7f66b33-9565-4aaa-bc80-63d9a21c0709
Sep 04 16:05:19 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:19 devstack sudo[105464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:05:19 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:19 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6ca460df-bd37-4c40-b9ab-730470223ed8 tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e7f66b33-9565-4aaa-bc80-63d9a21c0709" returned: 0 in 0.297s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-6ca460df-bd37-4c40-b9ab-730470223ed8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-quobyte-e7f66b33-9565-4aaa-bc80-63d9a21c0709" released by "delete_volume" :: held 0.887s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:20 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2cf7643f-6541-48b4-ad1e-581e601dbce8 tempest-TestInstancesWithCinderVolumes-717012801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.351s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:20 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-2cf7643f-6541-48b4-ad1e-581e601dbce8 tempest-TestInstancesWithCinderVolumes-717012801 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:05:20 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-6ca460df-bd37-4c40-b9ab-730470223ed8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Created reservations ['29689563-50f8-45e9-8691-59769c907131', '0bcf43f1-bb5e-412c-9a74-0591e4e4bc67', '4c7515a6-1412-4303-b4a9-a8e25fd760f4', '998d0a1c-100f-42dc-a33f-4a6d712f435e'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:05:20 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-2cf7643f-6541-48b4-ad1e-581e601dbce8 tempest-TestInstancesWithCinderVolumes-717012801 None] Deleted volume successfully.
Sep 04 16:05:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2cf7643f-6541-48b4-ad1e-581e601dbce8 tempest-TestInstancesWithCinderVolumes-717012801 None] Lock "cinder-c803b736-e753-4380-b0fe-6555e14d23a2-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6ca460df-bd37-4c40-b9ab-730470223ed8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6ca460df-bd37-4c40-b9ab-730470223ed8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6ca460df-bd37-4c40-b9ab-730470223ed8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6ca460df-bd37-4c40-b9ab-730470223ed8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6ca460df-bd37-4c40-b9ab-730470223ed8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6ca460df-bd37-4c40-b9ab-730470223ed8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:20 devstack sudo[105472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:05:20 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-058b5c25-aa69-4986-84aa-394e1673057b tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "cinder-826dfa38-d762-46d2-ae40-c71fd3180926-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-058b5c25-aa69-4986-84aa-394e1673057b tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-826dfa38-d762-46d2-ae40-c71fd3180926-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-058b5c25-aa69-4986-84aa-394e1673057b tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "cinder-quobyte-826dfa38-d762-46d2-ae40-c71fd3180926" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-058b5c25-aa69-4986-84aa-394e1673057b tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-quobyte-826dfa38-d762-46d2-ae40-c71fd3180926" acquired by "delete_volume" :: waited 0.013s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:20 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[61979f29-dbc7-496b-b59f-1c38b47e60ab]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:05:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-058b5c25-aa69-4986-84aa-394e1673057b tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-826dfa38-d762-46d2-ae40-c71fd3180926 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:20 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6ca460df-bd37-4c40-b9ab-730470223ed8 tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.270s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:20 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-6ca460df-bd37-4c40-b9ab-730470223ed8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:05:20 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-6ca460df-bd37-4c40-b9ab-730470223ed8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Deleted volume successfully.
Sep 04 16:05:20 devstack sudo[105474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-826dfa38-d762-46d2-ae40-c71fd3180926
Sep 04 16:05:20 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-6ca460df-bd37-4c40-b9ab-730470223ed8 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-e7f66b33-9565-4aaa-bc80-63d9a21c0709-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:20 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-058b5c25-aa69-4986-84aa-394e1673057b tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-826dfa38-d762-46d2-ae40-c71fd3180926" returned: 0 in 0.408s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-058b5c25-aa69-4986-84aa-394e1673057b tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-826dfa38-d762-46d2-ae40-c71fd3180926 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:20 devstack sudo[105480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-826dfa38-d762-46d2-ae40-c71fd3180926
Sep 04 16:05:20 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:21 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-058b5c25-aa69-4986-84aa-394e1673057b tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-826dfa38-d762-46d2-ae40-c71fd3180926" returned: 0 in 0.287s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-058b5c25-aa69-4986-84aa-394e1673057b tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-quobyte-826dfa38-d762-46d2-ae40-c71fd3180926" released by "delete_volume" :: held 0.744s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:21 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-058b5c25-aa69-4986-84aa-394e1673057b tempest-CreateVolumesFromSnapshotTest-55027921 None] Created reservations ['3c31f7ee-94ed-48b7-96e1-23bb9cab0430', '7c007e66-efb9-4302-9af7-c13e42c6df99', '4ee6bb99-b50e-4281-ab3d-6d0e1287072d', '56c1fc87-0565-4148-9e3b-0bc7e1e97baa'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:05:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-058b5c25-aa69-4986-84aa-394e1673057b tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-058b5c25-aa69-4986-84aa-394e1673057b tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-058b5c25-aa69-4986-84aa-394e1673057b tempest-CreateVolumesFromSnapshotTest-55027921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-058b5c25-aa69-4986-84aa-394e1673057b tempest-CreateVolumesFromSnapshotTest-55027921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-058b5c25-aa69-4986-84aa-394e1673057b tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-058b5c25-aa69-4986-84aa-394e1673057b tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:21 devstack sudo[105483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:05:21 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e4e1b1a8-3fe7-414a-a472-f7b472327538 tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "cinder-1da7fc35-4bbd-49c1-86e3-21efbc66d97c-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e4e1b1a8-3fe7-414a-a472-f7b472327538 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-1da7fc35-4bbd-49c1-86e3-21efbc66d97c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:21 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e4e1b1a8-3fe7-414a-a472-f7b472327538 tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "cinder-quobyte-1da7fc35-4bbd-49c1-86e3-21efbc66d97c" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-058b5c25-aa69-4986-84aa-394e1673057b tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.410s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:21 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-058b5c25-aa69-4986-84aa-394e1673057b tempest-CreateVolumesFromSnapshotTest-55027921 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:05:21 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-058b5c25-aa69-4986-84aa-394e1673057b tempest-CreateVolumesFromSnapshotTest-55027921 None] Deleted volume successfully.
Sep 04 16:05:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e4e1b1a8-3fe7-414a-a472-f7b472327538 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-quobyte-1da7fc35-4bbd-49c1-86e3-21efbc66d97c" acquired by "delete_volume" :: waited 0.055s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-058b5c25-aa69-4986-84aa-394e1673057b tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-826dfa38-d762-46d2-ae40-c71fd3180926-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:21 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c92168-9c40-43df-9048-3a8035c821af]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:05:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e4e1b1a8-3fe7-414a-a472-f7b472327538 tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1da7fc35-4bbd-49c1-86e3-21efbc66d97c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:21 devstack sudo[105488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1da7fc35-4bbd-49c1-86e3-21efbc66d97c
Sep 04 16:05:21 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:22 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e4e1b1a8-3fe7-414a-a472-f7b472327538 tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1da7fc35-4bbd-49c1-86e3-21efbc66d97c" returned: 0 in 0.463s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e4e1b1a8-3fe7-414a-a472-f7b472327538 tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1da7fc35-4bbd-49c1-86e3-21efbc66d97c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:22 devstack sudo[105493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1da7fc35-4bbd-49c1-86e3-21efbc66d97c
Sep 04 16:05:22 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:22 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e4e1b1a8-3fe7-414a-a472-f7b472327538 tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1da7fc35-4bbd-49c1-86e3-21efbc66d97c" returned: 0 in 0.311s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e4e1b1a8-3fe7-414a-a472-f7b472327538 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-quobyte-1da7fc35-4bbd-49c1-86e3-21efbc66d97c" released by "delete_volume" :: held 0.852s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:22 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-e4e1b1a8-3fe7-414a-a472-f7b472327538 tempest-CreateVolumesFromSnapshotTest-55027921 None] Created reservations ['bd01992b-c87e-44c6-9026-4f73bf2a4532', 'eec567f1-ae25-4b99-832c-b720392747ec', 'dc20ac78-5efc-4f8b-9f06-ad2e71970e33', 'd4e7dd7a-1d74-4bd3-90da-0613a4cc16a7'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:05:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e4e1b1a8-3fe7-414a-a472-f7b472327538 tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e4e1b1a8-3fe7-414a-a472-f7b472327538 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e4e1b1a8-3fe7-414a-a472-f7b472327538 tempest-CreateVolumesFromSnapshotTest-55027921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e4e1b1a8-3fe7-414a-a472-f7b472327538 tempest-CreateVolumesFromSnapshotTest-55027921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e4e1b1a8-3fe7-414a-a472-f7b472327538 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e4e1b1a8-3fe7-414a-a472-f7b472327538 tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:22 devstack sudo[105496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:05:22 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-38cf5971-ba50-4130-ad1b-29142cae0f5e tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "cinder-5cd33b25-31cf-480b-82a3-a6c14c6d97ed-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-38cf5971-ba50-4130-ad1b-29142cae0f5e tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-5cd33b25-31cf-480b-82a3-a6c14c6d97ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-38cf5971-ba50-4130-ad1b-29142cae0f5e tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "cinder-quobyte-f38d371d-b888-4681-aa8b-f7172ec9af4f" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-38cf5971-ba50-4130-ad1b-29142cae0f5e tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-quobyte-f38d371d-b888-4681-aa8b-f7172ec9af4f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-38cf5971-ba50-4130-ad1b-29142cae0f5e tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "cinder-quobyte-5cd33b25-31cf-480b-82a3-a6c14c6d97ed" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-38cf5971-ba50-4130-ad1b-29142cae0f5e tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-quobyte-5cd33b25-31cf-480b-82a3-a6c14c6d97ed" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-38cf5971-ba50-4130-ad1b-29142cae0f5e tempest-CreateVolumesFromSnapshotTest-55027921 None] Deleting offline snapshot 5cd33b25-31cf-480b-82a3-a6c14c6d97ed of volume f38d371d-b888-4681-aa8b-f7172ec9af4f {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 16:05:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-38cf5971-ba50-4130-ad1b-29142cae0f5e tempest-CreateVolumesFromSnapshotTest-55027921 None] snapshot_file for this snap is: volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.5cd33b25-31cf-480b-82a3-a6c14c6d97ed {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 16:05:22 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4f33e9-faea-494f-b979-4c07b997e5b1]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:05:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-38cf5971-ba50-4130-ad1b-29142cae0f5e tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.5cd33b25-31cf-480b-82a3-a6c14c6d97ed {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:23 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e4e1b1a8-3fe7-414a-a472-f7b472327538 tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.373s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:23 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-e4e1b1a8-3fe7-414a-a472-f7b472327538 tempest-CreateVolumesFromSnapshotTest-55027921 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:05:23 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e4e1b1a8-3fe7-414a-a472-f7b472327538 tempest-CreateVolumesFromSnapshotTest-55027921 None] Deleted volume successfully.
Sep 04 16:05:23 devstack sudo[105498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.5cd33b25-31cf-480b-82a3-a6c14c6d97ed
Sep 04 16:05:23 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e4e1b1a8-3fe7-414a-a472-f7b472327538 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-1da7fc35-4bbd-49c1-86e3-21efbc66d97c-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:23 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-38cf5971-ba50-4130-ad1b-29142cae0f5e tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.5cd33b25-31cf-480b-82a3-a6c14c6d97ed" returned: 0 in 0.464s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-38cf5971-ba50-4130-ad1b-29142cae0f5e tempest-CreateVolumesFromSnapshotTest-55027921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f38d371d-b888-4681-aa8b-f7172ec9af4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:05:23 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c480625-6980-4518-8e73-96fbe7bc7037]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:05:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-38cf5971-ba50-4130-ad1b-29142cae0f5e tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:23 devstack sudo[105504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f
Sep 04 16:05:23 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:23 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-38cf5971-ba50-4130-ad1b-29142cae0f5e tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f" returned: 0 in 0.435s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-38cf5971-ba50-4130-ad1b-29142cae0f5e tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.5cd33b25-31cf-480b-82a3-a6c14c6d97ed {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:23 devstack sudo[105510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.5cd33b25-31cf-480b-82a3-a6c14c6d97ed
Sep 04 16:05:23 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:24 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-38cf5971-ba50-4130-ad1b-29142cae0f5e tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.5cd33b25-31cf-480b-82a3-a6c14c6d97ed" returned: 0 in 0.440s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-38cf5971-ba50-4130-ad1b-29142cae0f5e tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.5cd33b25-31cf-480b-82a3-a6c14c6d97ed {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:24 devstack sudo[105515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.5cd33b25-31cf-480b-82a3-a6c14c6d97ed
Sep 04 16:05:24 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:24 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-38cf5971-ba50-4130-ad1b-29142cae0f5e tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f.5cd33b25-31cf-480b-82a3-a6c14c6d97ed" returned: 0 in 0.354s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-38cf5971-ba50-4130-ad1b-29142cae0f5e tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-quobyte-5cd33b25-31cf-480b-82a3-a6c14c6d97ed" released by "_delete_snapshot" :: held 1.876s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-38cf5971-ba50-4130-ad1b-29142cae0f5e tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-quobyte-f38d371d-b888-4681-aa8b-f7172ec9af4f" released by "delete_snapshot" :: held 1.918s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:24 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-38cf5971-ba50-4130-ad1b-29142cae0f5e tempest-CreateVolumesFromSnapshotTest-55027921 None] Created reservations ['50248df0-8491-4f71-b3a0-2a8d331437ee', 'd5f73ea9-d9d9-4fb0-a29d-cc29dd87a042', 'eb7b73c7-5b39-4dbc-b323-a3a7c31d76bb', '73ee49c9-71e2-4c3b-b3a4-3aef8dfe453e'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:05:24 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-38cf5971-ba50-4130-ad1b-29142cae0f5e tempest-CreateVolumesFromSnapshotTest-55027921 None] Delete snapshot completed successfully.
Sep 04 16:05:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-38cf5971-ba50-4130-ad1b-29142cae0f5e tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-5cd33b25-31cf-480b-82a3-a6c14c6d97ed-delete_snapshot" released by "delete_snapshot" :: held 2.131s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-515e0cb7-be4f-4484-9bc3-499eba314e43 tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "cinder-f38d371d-b888-4681-aa8b-f7172ec9af4f-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:26 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-515e0cb7-be4f-4484-9bc3-499eba314e43 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-f38d371d-b888-4681-aa8b-f7172ec9af4f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:26 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-515e0cb7-be4f-4484-9bc3-499eba314e43 tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "cinder-quobyte-f38d371d-b888-4681-aa8b-f7172ec9af4f" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:26 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-515e0cb7-be4f-4484-9bc3-499eba314e43 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-quobyte-f38d371d-b888-4681-aa8b-f7172ec9af4f" acquired by "delete_volume" :: waited 0.028s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:26 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[66408a48-6084-4513-b45a-be11b5fbf0ae]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:05:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-515e0cb7-be4f-4484-9bc3-499eba314e43 tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:26 devstack sudo[105519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f
Sep 04 16:05:26 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:26 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-515e0cb7-be4f-4484-9bc3-499eba314e43 tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f" returned: 0 in 0.481s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-515e0cb7-be4f-4484-9bc3-499eba314e43 tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:26 devstack sudo[105524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f
Sep 04 16:05:26 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:26 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-515e0cb7-be4f-4484-9bc3-499eba314e43 tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f38d371d-b888-4681-aa8b-f7172ec9af4f" returned: 0 in 0.272s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:26 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-515e0cb7-be4f-4484-9bc3-499eba314e43 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-quobyte-f38d371d-b888-4681-aa8b-f7172ec9af4f" released by "delete_volume" :: held 0.853s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:27 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-515e0cb7-be4f-4484-9bc3-499eba314e43 tempest-CreateVolumesFromSnapshotTest-55027921 None] Created reservations ['2428b579-f8ef-4410-abd3-079a86db9bc0', 'a71f7c64-baec-4bd0-a15a-a99957ec91e5', 'f1aa11f9-b3a2-4074-a4e2-6b69e353d43a', '21bf96ec-0d78-4a4a-bf0b-49d851724e4b'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:05:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-515e0cb7-be4f-4484-9bc3-499eba314e43 tempest-CreateVolumesFromSnapshotTest-55027921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-515e0cb7-be4f-4484-9bc3-499eba314e43 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-515e0cb7-be4f-4484-9bc3-499eba314e43 tempest-CreateVolumesFromSnapshotTest-55027921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-515e0cb7-be4f-4484-9bc3-499eba314e43 tempest-CreateVolumesFromSnapshotTest-55027921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-515e0cb7-be4f-4484-9bc3-499eba314e43 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-515e0cb7-be4f-4484-9bc3-499eba314e43 tempest-CreateVolumesFromSnapshotTest-55027921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:27 devstack sudo[105527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:05:27 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:27 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-515e0cb7-be4f-4484-9bc3-499eba314e43 tempest-CreateVolumesFromSnapshotTest-55027921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.325s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:27 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-515e0cb7-be4f-4484-9bc3-499eba314e43 tempest-CreateVolumesFromSnapshotTest-55027921 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:05:27 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-515e0cb7-be4f-4484-9bc3-499eba314e43 tempest-CreateVolumesFromSnapshotTest-55027921 None] Deleted volume successfully.
Sep 04 16:05:27 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-515e0cb7-be4f-4484-9bc3-499eba314e43 tempest-CreateVolumesFromSnapshotTest-55027921 None] Lock "cinder-f38d371d-b888-4681-aa8b-f7172ec9af4f-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:31 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:05:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Flow 'volume_create_manager' (97798b54-cfea-4eb5-a095-5d505ea5c0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf8a30a0-6022-4891-b852-bef1d45d015a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf8a30a0-6022-4891-b852-bef1d45d015a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1676802267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c1ec53-85eb-4ed2-a276-d9896d33c010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bec8af5a7d84f66904e5b48e3e6922d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:32Z,use_quota=True,user_id='5867ef6c35f249bcb9c7bfa25010277a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205b3dc0-86cd-47e0-b2a6-9834e85ae4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205b3dc0-86cd-47e0-b2a6-9834e85ae4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221151c4-1e85-447f-88cc-1c00837b3186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221151c4-1e85-447f-88cc-1c00837b3186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9c1ec53-85eb-4ed2-a276-d9896d33c010', 'volume_name': 'volume-a9c1ec53-85eb-4ed2-a276-d9896d33c010', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df270591-a4ea-4763-a9a4-51d378f5194b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df270591-a4ea-4763-a9a4-51d378f5194b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe38eb2-c13e-4e62-9509-dba1fb1b1670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:31 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Volume a9c1ec53-85eb-4ed2-a276-d9896d33c010: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9c1ec53-85eb-4ed2-a276-d9896d33c010', 'volume_size': 1}
Sep 04 16:05:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1676802267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c1ec53-85eb-4ed2-a276-d9896d33c010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bec8af5a7d84f66904e5b48e3e6922d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:32Z,use_quota=True,user_id='5867ef6c35f249bcb9c7bfa25010277a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:05:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Creating volume a9c1ec53-85eb-4ed2-a276-d9896d33c010 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:05:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:05:31 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:05:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a9c1ec53-85eb-4ed2-a276-d9896d33c010 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:31 devstack sudo[105532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a9c1ec53-85eb-4ed2-a276-d9896d33c010 1073741824
Sep 04 16:05:31 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:32 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a9c1ec53-85eb-4ed2-a276-d9896d33c010 1073741824" returned: 0 in 0.612s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a9c1ec53-85eb-4ed2-a276-d9896d33c010 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:32 devstack sudo[105538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a9c1ec53-85eb-4ed2-a276-d9896d33c010
Sep 04 16:05:32 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:32 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a9c1ec53-85eb-4ed2-a276-d9896d33c010" returned: 0 in 0.322s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:32 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:05:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:32 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe38eb2-c13e-4e62-9509-dba1fb1b1670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9c1ec53-85eb-4ed2-a276-d9896d33c010', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:32 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16dcbf7f-8462-424c-bccd-fb0edc00e501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:32 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Volume volume-a9c1ec53-85eb-4ed2-a276-d9896d33c010 (a9c1ec53-85eb-4ed2-a276-d9896d33c010): created successfully
Sep 04 16:05:32 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16dcbf7f-8462-424c-bccd-fb0edc00e501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:32 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Flow 'volume_create_manager' (97798b54-cfea-4eb5-a095-5d505ea5c0b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:32 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-5ac26f7a-5a43-4700-ba12-2aa801a8270a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Created volume successfully.
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Flow 'volume_create_manager' (b498dead-1f5b-4e02-9b57-89d54689f6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebe9c56-b035-4140-831a-b3f2bd5fe28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebe9c56-b035-4140-831a-b3f2bd5fe28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-478095466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bcc68ec-cf2f-4061-a40d-25ddfea44758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bec8af5a7d84f66904e5b48e3e6922d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:34Z,use_quota=True,user_id='5867ef6c35f249bcb9c7bfa25010277a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3415be5e-0b3e-4063-9553-6d3d832ffd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3415be5e-0b3e-4063-9553-6d3d832ffd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9780a985-00b4-487d-8c0e-a76724f37b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9780a985-00b4-487d-8c0e-a76724f37b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bcc68ec-cf2f-4061-a40d-25ddfea44758', 'volume_name': 'volume-1bcc68ec-cf2f-4061-a40d-25ddfea44758', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfaf06ed-2760-49af-b05f-f1683cfab880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfaf06ed-2760-49af-b05f-f1683cfab880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bf9907-3701-4891-8767-a4f8f159b9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:34 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Volume 1bcc68ec-cf2f-4061-a40d-25ddfea44758: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bcc68ec-cf2f-4061-a40d-25ddfea44758', 'volume_size': 1}
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-478095466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bcc68ec-cf2f-4061-a40d-25ddfea44758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bec8af5a7d84f66904e5b48e3e6922d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:34Z,use_quota=True,user_id='5867ef6c35f249bcb9c7bfa25010277a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Creating volume 1bcc68ec-cf2f-4061-a40d-25ddfea44758 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:05:34 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1bcc68ec-cf2f-4061-a40d-25ddfea44758 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:34 devstack sudo[105542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1bcc68ec-cf2f-4061-a40d-25ddfea44758 1073741824
Sep 04 16:05:34 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Flow 'volume_create_manager' (e4da01b1-0ff4-4e34-8339-ebd85574bebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (385bf0d9-3f7b-48fa-a5dd-94ec3d0be482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (385bf0d9-3f7b-48fa-a5dd-94ec3d0be482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-749010572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bec8af5a7d84f66904e5b48e3e6922d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:35Z,use_quota=True,user_id='5867ef6c35f249bcb9c7bfa25010277a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e4a393-822f-4bc5-a65a-4a34005e42a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e4a393-822f-4bc5-a65a-4a34005e42a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2151e3c8-3918-488d-a80a-b69633947f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2151e3c8-3918-488d-a80a-b69633947f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131', 'volume_name': 'volume-3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb947cf-b445-475d-be6d-9c971c8f0d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb947cf-b445-475d-be6d-9c971c8f0d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5dec035-7ef4-44b0-9601-c13f2c60974e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:35 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Volume 3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131', 'volume_size': 1}
Sep 04 16:05:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:35 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1bcc68ec-cf2f-4061-a40d-25ddfea44758 1073741824" returned: 0 in 0.767s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1bcc68ec-cf2f-4061-a40d-25ddfea44758 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:35 devstack sudo[105548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1bcc68ec-cf2f-4061-a40d-25ddfea44758
Sep 04 16:05:35 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:35 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:05:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Flow 'volume_create_manager' (c2e07574-b38a-4033-8d55-07a0bb32f260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4bef03-ef26-41cd-b4da-450c46a20b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4bef03-ef26-41cd-b4da-450c46a20b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1409088137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b60eef4-f34b-4963-8dfc-c5113d49058e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bec8af5a7d84f66904e5b48e3e6922d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:35Z,use_quota=True,user_id='5867ef6c35f249bcb9c7bfa25010277a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84f170c-1abf-4784-b26c-03590923e07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84f170c-1abf-4784-b26c-03590923e07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c73ae68-27c6-4d67-90a3-ec0461991290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c73ae68-27c6-4d67-90a3-ec0461991290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b60eef4-f34b-4963-8dfc-c5113d49058e', 'volume_name': 'volume-6b60eef4-f34b-4963-8dfc-c5113d49058e', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6889675f-791c-4a2e-ae7a-8e1f4fc0e0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6889675f-791c-4a2e-ae7a-8e1f4fc0e0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b37e6cb7-56df-4270-bb48-e28fe3e1af0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:35 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Volume 6b60eef4-f34b-4963-8dfc-c5113d49058e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b60eef4-f34b-4963-8dfc-c5113d49058e', 'volume_size': 1}
Sep 04 16:05:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:36 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1bcc68ec-cf2f-4061-a40d-25ddfea44758" returned: 0 in 0.637s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.999s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-749010572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bec8af5a7d84f66904e5b48e3e6922d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:35Z,use_quota=True,user_id='5867ef6c35f249bcb9c7bfa25010277a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Creating volume 3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:05:36 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bf9907-3701-4891-8767-a4f8f159b9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bcc68ec-cf2f-4061-a40d-25ddfea44758', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4fcdff-98b1-4fb5-8824-05443cbd0e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:36 devstack sudo[105552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131 1073741824
Sep 04 16:05:36 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:36 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Volume volume-1bcc68ec-cf2f-4061-a40d-25ddfea44758 (1bcc68ec-cf2f-4061-a40d-25ddfea44758): created successfully
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4fcdff-98b1-4fb5-8824-05443cbd0e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Flow 'volume_create_manager' (b498dead-1f5b-4e02-9b57-89d54689f6f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:36 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-c16f1023-3963-40c0-b393-4e89fc552725 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Created volume successfully.
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Flow 'volume_create_manager' (96f6f14a-431f-4875-9c93-7ba242825f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026f4f3f-8c29-42e4-b622-37c70727f941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026f4f3f-8c29-42e4-b622-37c70727f941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-953279476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05e357a-af70-4ee4-b72d-aeeacc71ec75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bec8af5a7d84f66904e5b48e3e6922d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:36Z,use_quota=True,user_id='5867ef6c35f249bcb9c7bfa25010277a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ba70d4-04b3-4ff4-85f2-e5bf07b69f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ba70d4-04b3-4ff4-85f2-e5bf07b69f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681884ec-a515-447b-a60f-c717038b9b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681884ec-a515-447b-a60f-c717038b9b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b05e357a-af70-4ee4-b72d-aeeacc71ec75', 'volume_name': 'volume-b05e357a-af70-4ee4-b72d-aeeacc71ec75', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7093f2-8061-438f-95f2-64833838155a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7093f2-8061-438f-95f2-64833838155a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb2e3e66-e2eb-425d-b537-135044728553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:36 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Volume b05e357a-af70-4ee4-b72d-aeeacc71ec75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b05e357a-af70-4ee4-b72d-aeeacc71ec75', 'volume_size': 1}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:36 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131 1073741824" returned: 0 in 0.794s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:05:36 devstack sudo[105559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131
Sep 04 16:05:36 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Flow 'volume_create_manager' (b3cd403c-6493-4a99-b194-0a6ebaad4051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:36 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cea407-78a1-4dfc-9a2e-734cfa6cbe15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cea407-78a1-4dfc-9a2e-734cfa6cbe15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-226102129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b27bb7-e705-4624-b2f3-02ab96be4a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bec8af5a7d84f66904e5b48e3e6922d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:37Z,use_quota=True,user_id='5867ef6c35f249bcb9c7bfa25010277a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12296e3f-44bf-4509-9001-92b1763a13c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12296e3f-44bf-4509-9001-92b1763a13c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42e10ed-f9e5-434b-ae49-7ed57139f215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42e10ed-f9e5-434b-ae49-7ed57139f215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25b27bb7-e705-4624-b2f3-02ab96be4a72', 'volume_name': 'volume-25b27bb7-e705-4624-b2f3-02ab96be4a72', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2a45b2-189c-4967-95f8-3e16b33c3b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2a45b2-189c-4967-95f8-3e16b33c3b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ed51185-a748-4600-bc36-c3e058f10a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:37 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Volume 25b27bb7-e705-4624-b2f3-02ab96be4a72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25b27bb7-e705-4624-b2f3-02ab96be4a72', 'volume_size': 1}
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:37 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131" returned: 0 in 0.293s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.452s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1409088137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b60eef4-f34b-4963-8dfc-c5113d49058e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bec8af5a7d84f66904e5b48e3e6922d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:35Z,use_quota=True,user_id='5867ef6c35f249bcb9c7bfa25010277a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Creating volume 6b60eef4-f34b-4963-8dfc-c5113d49058e {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:05:37 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6b60eef4-f34b-4963-8dfc-c5113d49058e 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5dec035-7ef4-44b0-9601-c13f2c60974e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e754b1-2c5d-4dcd-a08f-f15587dccdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:37 devstack sudo[105562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6b60eef4-f34b-4963-8dfc-c5113d49058e 1073741824
Sep 04 16:05:37 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:37 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Volume volume-3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131 (3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131): created successfully
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e754b1-2c5d-4dcd-a08f-f15587dccdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Flow 'volume_create_manager' (e4da01b1-0ff4-4e34-8339-ebd85574bebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:37 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-27f453ae-a9db-4181-b336-8660714c712a tempest-CreateVolumesFromSourceVolumeTest-296544 None] Created volume successfully.
Sep 04 16:05:37 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6b60eef4-f34b-4963-8dfc-c5113d49058e 1073741824" returned: 0 in 0.685s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6b60eef4-f34b-4963-8dfc-c5113d49058e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:38 devstack sudo[105568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6b60eef4-f34b-4963-8dfc-c5113d49058e
Sep 04 16:05:38 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:38 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6b60eef4-f34b-4963-8dfc-c5113d49058e" returned: 0 in 0.304s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:05:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.967s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-953279476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05e357a-af70-4ee4-b72d-aeeacc71ec75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bec8af5a7d84f66904e5b48e3e6922d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:36Z,use_quota=True,user_id='5867ef6c35f249bcb9c7bfa25010277a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:05:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Creating volume b05e357a-af70-4ee4-b72d-aeeacc71ec75 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:05:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:05:38 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:05:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b05e357a-af70-4ee4-b72d-aeeacc71ec75 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b37e6cb7-56df-4270-bb48-e28fe3e1af0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b60eef4-f34b-4963-8dfc-c5113d49058e', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303d7bd4-a564-4cdc-8cd7-bcfec9273580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:38 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Volume volume-6b60eef4-f34b-4963-8dfc-c5113d49058e (6b60eef4-f34b-4963-8dfc-c5113d49058e): created successfully
Sep 04 16:05:38 devstack sudo[105571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b05e357a-af70-4ee4-b72d-aeeacc71ec75 1073741824
Sep 04 16:05:38 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303d7bd4-a564-4cdc-8cd7-bcfec9273580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Flow 'volume_create_manager' (c2e07574-b38a-4033-8d55-07a0bb32f260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:38 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-1316ad75-5e9a-48ea-babf-34f39538a411 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Created volume successfully.
Sep 04 16:05:38 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b05e357a-af70-4ee4-b72d-aeeacc71ec75 1073741824" returned: 0 in 0.630s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b05e357a-af70-4ee4-b72d-aeeacc71ec75 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:39 devstack sudo[105577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b05e357a-af70-4ee4-b72d-aeeacc71ec75
Sep 04 16:05:39 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:39 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b05e357a-af70-4ee4-b72d-aeeacc71ec75" returned: 0 in 0.277s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:39 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:05:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.253s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:39 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-226102129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b27bb7-e705-4624-b2f3-02ab96be4a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bec8af5a7d84f66904e5b48e3e6922d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:37Z,use_quota=True,user_id='5867ef6c35f249bcb9c7bfa25010277a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:05:39 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Creating volume 25b27bb7-e705-4624-b2f3-02ab96be4a72 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:05:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:39 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:39 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:39 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:05:39 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:05:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-25b27bb7-e705-4624-b2f3-02ab96be4a72 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb2e3e66-e2eb-425d-b537-135044728553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b05e357a-af70-4ee4-b72d-aeeacc71ec75', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:39 devstack sudo[105580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-25b27bb7-e705-4624-b2f3-02ab96be4a72 1073741824
Sep 04 16:05:39 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7481409-7c07-438f-bbe7-af265d2b861c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:39 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Volume volume-b05e357a-af70-4ee4-b72d-aeeacc71ec75 (b05e357a-af70-4ee4-b72d-aeeacc71ec75): created successfully
Sep 04 16:05:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7481409-7c07-438f-bbe7-af265d2b861c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Flow 'volume_create_manager' (96f6f14a-431f-4875-9c93-7ba242825f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:39 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-0aabd689-8464-4ab3-83a5-ecf1831e1369 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Created volume successfully.
Sep 04 16:05:39 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-25b27bb7-e705-4624-b2f3-02ab96be4a72 1073741824" returned: 0 in 0.592s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-25b27bb7-e705-4624-b2f3-02ab96be4a72 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:39 devstack sudo[105586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-25b27bb7-e705-4624-b2f3-02ab96be4a72
Sep 04 16:05:39 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:40 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-25b27bb7-e705-4624-b2f3-02ab96be4a72" returned: 0 in 0.309s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:40 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:05:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ed51185-a748-4600-bc36-c3e058f10a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25b27bb7-e705-4624-b2f3-02ab96be4a72', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf73174-3f11-46ff-b19c-6f5256222a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:40 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Volume volume-25b27bb7-e705-4624-b2f3-02ab96be4a72 (25b27bb7-e705-4624-b2f3-02ab96be4a72): created successfully
Sep 04 16:05:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf73174-3f11-46ff-b19c-6f5256222a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Flow 'volume_create_manager' (b3cd403c-6493-4a99-b194-0a6ebaad4051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:40 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-366eb766-1c09-448e-bd09-d25151e6f920 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Created volume successfully.
Sep 04 16:05:41 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8ae305ec-41b2-473d-a2e9-b337a9025afa tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "cinder-25b27bb7-e705-4624-b2f3-02ab96be4a72-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:41 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8ae305ec-41b2-473d-a2e9-b337a9025afa tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "cinder-25b27bb7-e705-4624-b2f3-02ab96be4a72-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:41 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=147,cinder:UPDATE=185,cinder:INSERT=35,cinder:DELETE=15 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:05:41 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:UPDATE=178,cinder:SELECT=125,cinder:DELETE=18,cinder:INSERT=47 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:05:41 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8ae305ec-41b2-473d-a2e9-b337a9025afa tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "cinder-quobyte-25b27bb7-e705-4624-b2f3-02ab96be4a72" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:41 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8ae305ec-41b2-473d-a2e9-b337a9025afa tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "cinder-quobyte-25b27bb7-e705-4624-b2f3-02ab96be4a72" acquired by "delete_volume" :: waited 0.034s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:41 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dae491-5a91-4d9a-b22a-2dcbc7eedc76]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:05:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8ae305ec-41b2-473d-a2e9-b337a9025afa tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-25b27bb7-e705-4624-b2f3-02ab96be4a72 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:41 devstack sudo[105589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-25b27bb7-e705-4624-b2f3-02ab96be4a72
Sep 04 16:05:41 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:42 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8ae305ec-41b2-473d-a2e9-b337a9025afa tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-25b27bb7-e705-4624-b2f3-02ab96be4a72" returned: 0 in 0.569s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8ae305ec-41b2-473d-a2e9-b337a9025afa tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-25b27bb7-e705-4624-b2f3-02ab96be4a72 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:42 devstack sudo[105594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-25b27bb7-e705-4624-b2f3-02ab96be4a72
Sep 04 16:05:42 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:42 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8ae305ec-41b2-473d-a2e9-b337a9025afa tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-25b27bb7-e705-4624-b2f3-02ab96be4a72" returned: 0 in 0.306s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8ae305ec-41b2-473d-a2e9-b337a9025afa tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "cinder-quobyte-25b27bb7-e705-4624-b2f3-02ab96be4a72" released by "delete_volume" :: held 0.958s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Flow 'volume_create_manager' (1079599a-c5ca-44b8-84c4-2fbc4bcbe7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7032e74-3242-43a6-a36e-5dbf00fbe90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7032e74-3242-43a6-a36e-5dbf00fbe90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-219625411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b3f4eee-c648-4c2f-a529-8cb086fffb58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e0cd9b68ed4c9cbb7af3f25d81ca99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:43Z,use_quota=True,user_id='17e349c6f0eb45ffbbbe3aec1d114ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (550ee6d9-cd03-4a05-981b-8cb497b1f7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (550ee6d9-cd03-4a05-981b-8cb497b1f7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e2909c-4377-4a0a-bf87-bbef04a46545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e2909c-4377-4a0a-bf87-bbef04a46545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b3f4eee-c648-4c2f-a529-8cb086fffb58', 'volume_name': 'volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300a3625-1259-41d9-834a-f64cc5601932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300a3625-1259-41d9-834a-f64cc5601932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93cc6aa7-3c27-4aef-94e0-d0932ed3639b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:42 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Volume 4b3f4eee-c648-4c2f-a529-8cb086fffb58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58', 'volume_size': 1}
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-219625411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b3f4eee-c648-4c2f-a529-8cb086fffb58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e0cd9b68ed4c9cbb7af3f25d81ca99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:43Z,use_quota=True,user_id='17e349c6f0eb45ffbbbe3aec1d114ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Creating volume 4b3f4eee-c648-4c2f-a529-8cb086fffb58 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:05:42 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:42 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-8ae305ec-41b2-473d-a2e9-b337a9025afa tempest-CreateVolumesFromSourceVolumeTest-296544 None] Created reservations ['f84e75cb-3647-4ed4-b83c-87d9b4ccee16', 'b1bdbe4d-e705-4828-9c8b-515431c49f25', 'c0d24ced-bc46-47ae-b357-04ff28a1cb17', '88098782-0b17-4525-8c53-54eb73cf1fab'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:05:42 devstack sudo[105597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58 1073741824
Sep 04 16:05:42 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-8ae305ec-41b2-473d-a2e9-b337a9025afa tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-8ae305ec-41b2-473d-a2e9-b337a9025afa tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-8ae305ec-41b2-473d-a2e9-b337a9025afa tempest-CreateVolumesFromSourceVolumeTest-296544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-8ae305ec-41b2-473d-a2e9-b337a9025afa tempest-CreateVolumesFromSourceVolumeTest-296544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-8ae305ec-41b2-473d-a2e9-b337a9025afa tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8ae305ec-41b2-473d-a2e9-b337a9025afa tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:43 devstack sudo[105599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:05:43 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:43 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8ae305ec-41b2-473d-a2e9-b337a9025afa tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.330s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:43 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-8ae305ec-41b2-473d-a2e9-b337a9025afa tempest-CreateVolumesFromSourceVolumeTest-296544 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:05:43 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-8ae305ec-41b2-473d-a2e9-b337a9025afa tempest-CreateVolumesFromSourceVolumeTest-296544 None] Deleted volume successfully.
Sep 04 16:05:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8ae305ec-41b2-473d-a2e9-b337a9025afa tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "cinder-25b27bb7-e705-4624-b2f3-02ab96be4a72-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:43 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58 1073741824" returned: 0 in 0.543s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:43 devstack sudo[105606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58
Sep 04 16:05:43 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:43 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58" returned: 0 in 0.379s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:05:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93cc6aa7-3c27-4aef-94e0-d0932ed3639b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7326b00a-be28-4b92-b416-664328db926d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7f2f53c7-9463-49a4-b385-a9fd2c152846 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "cinder-b05e357a-af70-4ee4-b72d-aeeacc71ec75-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:43 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Volume volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58 (4b3f4eee-c648-4c2f-a529-8cb086fffb58): created successfully
Sep 04 16:05:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7326b00a-be28-4b92-b416-664328db926d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Flow 'volume_create_manager' (1079599a-c5ca-44b8-84c4-2fbc4bcbe7b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7f2f53c7-9463-49a4-b385-a9fd2c152846 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "cinder-b05e357a-af70-4ee4-b72d-aeeacc71ec75-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:43 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-13b56b66-8c93-4f40-8acf-3025f1a98a04 tempest-TestImageHashVerification-39878482 None] Created volume successfully.
Sep 04 16:05:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7f2f53c7-9463-49a4-b385-a9fd2c152846 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "cinder-quobyte-b05e357a-af70-4ee4-b72d-aeeacc71ec75" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7f2f53c7-9463-49a4-b385-a9fd2c152846 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "cinder-quobyte-b05e357a-af70-4ee4-b72d-aeeacc71ec75" acquired by "delete_volume" :: waited 0.017s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:44 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[80811fd9-2d7a-4257-a67f-b7196a1b6d02]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:05:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7f2f53c7-9463-49a4-b385-a9fd2c152846 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b05e357a-af70-4ee4-b72d-aeeacc71ec75 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:44 devstack sudo[105611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b05e357a-af70-4ee4-b72d-aeeacc71ec75
Sep 04 16:05:44 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:44 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7f2f53c7-9463-49a4-b385-a9fd2c152846 tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b05e357a-af70-4ee4-b72d-aeeacc71ec75" returned: 0 in 0.393s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7f2f53c7-9463-49a4-b385-a9fd2c152846 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b05e357a-af70-4ee4-b72d-aeeacc71ec75 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:44 devstack sudo[105616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b05e357a-af70-4ee4-b72d-aeeacc71ec75
Sep 04 16:05:44 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:44 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7f2f53c7-9463-49a4-b385-a9fd2c152846 tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b05e357a-af70-4ee4-b72d-aeeacc71ec75" returned: 0 in 0.255s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7f2f53c7-9463-49a4-b385-a9fd2c152846 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "cinder-quobyte-b05e357a-af70-4ee4-b72d-aeeacc71ec75" released by "delete_volume" :: held 0.701s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:44 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-7f2f53c7-9463-49a4-b385-a9fd2c152846 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Created reservations ['33013f7d-6441-43d0-8b6e-5397310ccba1', '3a7bfe27-155d-42ea-85e1-065adbff7ad7', '719ad44e-bdbb-44d4-a8b1-0545c179afbf', 'f9549811-a50e-4d7f-a896-5446a411454b'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:05:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7f2f53c7-9463-49a4-b385-a9fd2c152846 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7f2f53c7-9463-49a4-b385-a9fd2c152846 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7f2f53c7-9463-49a4-b385-a9fd2c152846 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7f2f53c7-9463-49a4-b385-a9fd2c152846 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7f2f53c7-9463-49a4-b385-a9fd2c152846 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7f2f53c7-9463-49a4-b385-a9fd2c152846 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:44 devstack sudo[105620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:05:44 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:45 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-be80dd38-9fae-4b68-be53-29d7e248ce42 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "cinder-6b60eef4-f34b-4963-8dfc-c5113d49058e-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:45 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-be80dd38-9fae-4b68-be53-29d7e248ce42 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "cinder-6b60eef4-f34b-4963-8dfc-c5113d49058e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:45 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-be80dd38-9fae-4b68-be53-29d7e248ce42 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "cinder-quobyte-6b60eef4-f34b-4963-8dfc-c5113d49058e" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:45 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-be80dd38-9fae-4b68-be53-29d7e248ce42 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "cinder-quobyte-6b60eef4-f34b-4963-8dfc-c5113d49058e" acquired by "delete_volume" :: waited 0.019s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:45 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de5d17e-5690-4f56-92fd-314f7151ef72]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:05:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-be80dd38-9fae-4b68-be53-29d7e248ce42 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6b60eef4-f34b-4963-8dfc-c5113d49058e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:45 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7f2f53c7-9463-49a4-b385-a9fd2c152846 tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.354s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:45 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-7f2f53c7-9463-49a4-b385-a9fd2c152846 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:05:45 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-7f2f53c7-9463-49a4-b385-a9fd2c152846 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Deleted volume successfully.
Sep 04 16:05:45 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7f2f53c7-9463-49a4-b385-a9fd2c152846 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "cinder-b05e357a-af70-4ee4-b72d-aeeacc71ec75-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:45 devstack sudo[105623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6b60eef4-f34b-4963-8dfc-c5113d49058e
Sep 04 16:05:45 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:45 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-be80dd38-9fae-4b68-be53-29d7e248ce42 tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6b60eef4-f34b-4963-8dfc-c5113d49058e" returned: 0 in 0.446s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-be80dd38-9fae-4b68-be53-29d7e248ce42 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6b60eef4-f34b-4963-8dfc-c5113d49058e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:45 devstack sudo[105628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6b60eef4-f34b-4963-8dfc-c5113d49058e
Sep 04 16:05:45 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-74a1ea69-e221-4b45-b31f-a09f090843bf tempest-TestImageHashVerification-39878482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-74a1ea69-e221-4b45-b31f-a09f090843bf tempest-TestImageHashVerification-39878482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:45 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79f7186-1b2b-4f46-a1d9-88c1aebe9de8]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:05:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-74a1ea69-e221-4b45-b31f-a09f090843bf tempest-TestImageHashVerification-39878482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:46 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-be80dd38-9fae-4b68-be53-29d7e248ce42 tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6b60eef4-f34b-4963-8dfc-c5113d49058e" returned: 0 in 0.327s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:46 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-be80dd38-9fae-4b68-be53-29d7e248ce42 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "cinder-quobyte-6b60eef4-f34b-4963-8dfc-c5113d49058e" released by "delete_volume" :: held 0.844s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:46 devstack sudo[105630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58
Sep 04 16:05:46 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:46 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-be80dd38-9fae-4b68-be53-29d7e248ce42 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Created reservations ['7b0ea05e-0e0d-4b65-858c-907a8c93dcc0', 'cc52a9d9-f360-4e80-9bd8-beba15d05028', '5aaaab6c-8ef0-4d2a-b936-01e38338757c', '3d16d9a5-4fc1-47a4-8c2b-36c19c1fe418'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:05:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-be80dd38-9fae-4b68-be53-29d7e248ce42 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-be80dd38-9fae-4b68-be53-29d7e248ce42 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:46 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-be80dd38-9fae-4b68-be53-29d7e248ce42 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:46 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-be80dd38-9fae-4b68-be53-29d7e248ce42 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-be80dd38-9fae-4b68-be53-29d7e248ce42 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-be80dd38-9fae-4b68-be53-29d7e248ce42 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:46 devstack sudo[105633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:05:46 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:46 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1789cfba-4e68-4af5-958b-7de21147d6bd tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "cinder-3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:46 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1789cfba-4e68-4af5-958b-7de21147d6bd tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "cinder-3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:46 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1789cfba-4e68-4af5-958b-7de21147d6bd tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "cinder-quobyte-3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:46 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1789cfba-4e68-4af5-958b-7de21147d6bd tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "cinder-quobyte-3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131" acquired by "delete_volume" :: waited 0.024s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:46 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6501855-781e-4e80-8804-0862200409be]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:05:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1789cfba-4e68-4af5-958b-7de21147d6bd tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:46 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-74a1ea69-e221-4b45-b31f-a09f090843bf tempest-TestImageHashVerification-39878482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58" returned: 0 in 0.684s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:46 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[815b90fd-3a6a-49da-a6d9-dd07da8e0a8c]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:05:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-74a1ea69-e221-4b45-b31f-a09f090843bf tempest-TestImageHashVerification-39878482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:46 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-be80dd38-9fae-4b68-be53-29d7e248ce42 tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.480s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:46 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-be80dd38-9fae-4b68-be53-29d7e248ce42 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:05:46 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-be80dd38-9fae-4b68-be53-29d7e248ce42 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Deleted volume successfully.
Sep 04 16:05:46 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-be80dd38-9fae-4b68-be53-29d7e248ce42 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "cinder-6b60eef4-f34b-4963-8dfc-c5113d49058e-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:46 devstack sudo[105638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131
Sep 04 16:05:46 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:46 devstack sudo[105640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58
Sep 04 16:05:46 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:47 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:47 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1789cfba-4e68-4af5-958b-7de21147d6bd tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131" returned: 0 in 0.522s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1789cfba-4e68-4af5-958b-7de21147d6bd tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-74a1ea69-e221-4b45-b31f-a09f090843bf tempest-TestImageHashVerification-39878482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58" returned: 0 in 0.475s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-74a1ea69-e221-4b45-b31f-a09f090843bf tempest-TestImageHashVerification-39878482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58 /opt/stack/data/cinder/conversion/4b3f4eee-c648-4c2f-a529-8cb086fffb58.temp_image.47dfc582-4116-4a5a-8fa7-9606b6cd0372qjy0qdam.img {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:47 devstack sudo[105650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131
Sep 04 16:05:47 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:47 devstack sudo[105651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58 /opt/stack/data/cinder/conversion/4b3f4eee-c648-4c2f-a529-8cb086fffb58.temp_image.47dfc582-4116-4a5a-8fa7-9606b6cd0372qjy0qdam.img
Sep 04 16:05:47 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:47 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1789cfba-4e68-4af5-958b-7de21147d6bd tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131" returned: 0 in 0.285s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1789cfba-4e68-4af5-958b-7de21147d6bd tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "cinder-quobyte-3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131" released by "delete_volume" :: held 0.890s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:47 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-1789cfba-4e68-4af5-958b-7de21147d6bd tempest-CreateVolumesFromSourceVolumeTest-296544 None] Created reservations ['2a4ed55c-3b1d-4885-b2fc-244c48eb9186', '68b0d939-9cec-40bd-bdf4-2b36b1f86dfc', 'b796272d-c00b-406d-b499-eba69df224ab', '2f0b1712-1f09-4367-82c9-728944d1fb58'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:05:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1789cfba-4e68-4af5-958b-7de21147d6bd tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1789cfba-4e68-4af5-958b-7de21147d6bd tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:47 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1789cfba-4e68-4af5-958b-7de21147d6bd tempest-CreateVolumesFromSourceVolumeTest-296544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:47 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1789cfba-4e68-4af5-958b-7de21147d6bd tempest-CreateVolumesFromSourceVolumeTest-296544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1789cfba-4e68-4af5-958b-7de21147d6bd tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1789cfba-4e68-4af5-958b-7de21147d6bd tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:47 devstack sudo[105665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:05:47 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f6bc3125-46a5-4248-bd0d-cf7b19461099 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "cinder-1bcc68ec-cf2f-4061-a40d-25ddfea44758-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f6bc3125-46a5-4248-bd0d-cf7b19461099 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "cinder-1bcc68ec-cf2f-4061-a40d-25ddfea44758-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:48 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f6bc3125-46a5-4248-bd0d-cf7b19461099 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "cinder-quobyte-1bcc68ec-cf2f-4061-a40d-25ddfea44758" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:48 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:48 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f6bc3125-46a5-4248-bd0d-cf7b19461099 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "cinder-quobyte-1bcc68ec-cf2f-4061-a40d-25ddfea44758" acquired by "delete_volume" :: waited 0.055s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1789cfba-4e68-4af5-958b-7de21147d6bd tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.583s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:48 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-1789cfba-4e68-4af5-958b-7de21147d6bd tempest-CreateVolumesFromSourceVolumeTest-296544 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:05:48 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-1789cfba-4e68-4af5-958b-7de21147d6bd tempest-CreateVolumesFromSourceVolumeTest-296544 None] Deleted volume successfully.
Sep 04 16:05:48 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8aa1aa-1df1-473d-b16e-4d278be2cad1]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:05:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f6bc3125-46a5-4248-bd0d-cf7b19461099 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1bcc68ec-cf2f-4061-a40d-25ddfea44758 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:48 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1789cfba-4e68-4af5-958b-7de21147d6bd tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "cinder-3ac0b1e1-40c3-4c2c-8fe2-207ef3bf4131-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:48 devstack sudo[105668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1bcc68ec-cf2f-4061-a40d-25ddfea44758
Sep 04 16:05:48 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:48 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 16:05:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:48 devstack sudo[105671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:05:48 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:49 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f6bc3125-46a5-4248-bd0d-cf7b19461099 tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1bcc68ec-cf2f-4061-a40d-25ddfea44758" returned: 0 in 0.971s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f6bc3125-46a5-4248-bd0d-cf7b19461099 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1bcc68ec-cf2f-4061-a40d-25ddfea44758 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:49 devstack sudo[105676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1bcc68ec-cf2f-4061-a40d-25ddfea44758
Sep 04 16:05:49 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:49 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.619s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:49 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:05:49 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager._thread_info {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 16:05:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread count: 28 {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 16:05:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread info: [<_MainThread(MainThread, started 131673838448768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131673724603200)>, <Thread(Thread-3 (stat_writer), started daemon 131673723495936)>, <Thread(Rabbit-heartbeat, started daemon 131673723764800)>, <Thread(Thread-5 (_runner), started daemon 131673722269632)>, <Thread(Thread-7 (_runner), started daemon 131673722322112)>, <Thread(fd_logger, started daemon 131673722585024)>, <Thread(privsep_reader, started daemon 131673721593984)>, <Thread(tpool_thread_0, started daemon 131673714706112)>, <Thread(tpool_thread_1, started daemon 131673706313408)>, <Thread(tpool_thread_2, started daemon 131673697920704)>, <Thread(tpool_thread_3, started daemon 131673689528000)>, <Thread(tpool_thread_4, started daemon 131673681135296)>, <Thread(tpool_thread_5, started daemon 131673672726208)>, <Thread(tpool_thread_6, started daemon 131673664317120)>, <Thread(tpool_thread_7, started daemon 131673655908032)>, <Thread(tpool_thread_8, started daemon 131673647498944)>, <Thread(tpool_thread_9, started daemon 131673639089856)>, <Thread(tpool_thread_10, started daemon 131673630680768)>, <Thread(tpool_thread_11, started daemon 131673622271680)>, <Thread(tpool_thread_12, started daemon 131673613862592)>, <Thread(tpool_thread_13, started daemon 131673605453504)>, <Thread(tpool_thread_14, started daemon 131673597044416)>, <Thread(tpool_thread_15, started daemon 131673588635328)>, <Thread(tpool_thread_16, started daemon 131673580226240)>, <Thread(tpool_thread_17, started daemon 131673571817152)>, <Thread(tpool_thread_18, started daemon 131673563408064)>, <Thread(tpool_thread_19, started daemon 131673554998976)>] {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 16:05:49 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f6bc3125-46a5-4248-bd0d-cf7b19461099 tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1bcc68ec-cf2f-4061-a40d-25ddfea44758" returned: 0 in 0.577s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f6bc3125-46a5-4248-bd0d-cf7b19461099 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "cinder-quobyte-1bcc68ec-cf2f-4061-a40d-25ddfea44758" released by "delete_volume" :: held 1.690s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:50 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-f6bc3125-46a5-4248-bd0d-cf7b19461099 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Created reservations ['df94f4dd-cc33-4811-a21c-c3597a3da438', '30581b8f-6015-40da-bc48-a90d29e52f49', '9ee7be39-f61c-4208-aaad-1144494bc7ad', '5db80359-e905-41b4-a33d-ade7598bcdcf'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:05:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f6bc3125-46a5-4248-bd0d-cf7b19461099 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f6bc3125-46a5-4248-bd0d-cf7b19461099 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f6bc3125-46a5-4248-bd0d-cf7b19461099 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f6bc3125-46a5-4248-bd0d-cf7b19461099 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f6bc3125-46a5-4248-bd0d-cf7b19461099 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f6bc3125-46a5-4248-bd0d-cf7b19461099 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:50 devstack sudo[105681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:05:50 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d12a48df-8b66-49a0-a985-6b6d7e9935a9 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "cinder-a9c1ec53-85eb-4ed2-a276-d9896d33c010-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d12a48df-8b66-49a0-a985-6b6d7e9935a9 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "cinder-a9c1ec53-85eb-4ed2-a276-d9896d33c010-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d12a48df-8b66-49a0-a985-6b6d7e9935a9 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "cinder-quobyte-a9c1ec53-85eb-4ed2-a276-d9896d33c010" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:05:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d12a48df-8b66-49a0-a985-6b6d7e9935a9 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "cinder-quobyte-a9c1ec53-85eb-4ed2-a276-d9896d33c010" acquired by "delete_volume" :: waited 0.036s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:05:51 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b70d5e-f6dd-4550-9f3d-6dcd7b47ebc2]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:05:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d12a48df-8b66-49a0-a985-6b6d7e9935a9 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a9c1ec53-85eb-4ed2-a276-d9896d33c010 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:51 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f6bc3125-46a5-4248-bd0d-cf7b19461099 tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.872s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:51 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-f6bc3125-46a5-4248-bd0d-cf7b19461099 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:05:51 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f6bc3125-46a5-4248-bd0d-cf7b19461099 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Deleted volume successfully.
Sep 04 16:05:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f6bc3125-46a5-4248-bd0d-cf7b19461099 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "cinder-1bcc68ec-cf2f-4061-a40d-25ddfea44758-delete_volume" released by "delete_volume" :: held 3.352s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:51 devstack sudo[105684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a9c1ec53-85eb-4ed2-a276-d9896d33c010
Sep 04 16:05:51 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:52 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d12a48df-8b66-49a0-a985-6b6d7e9935a9 tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a9c1ec53-85eb-4ed2-a276-d9896d33c010" returned: 0 in 1.369s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d12a48df-8b66-49a0-a985-6b6d7e9935a9 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a9c1ec53-85eb-4ed2-a276-d9896d33c010 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:52 devstack sudo[105689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a9c1ec53-85eb-4ed2-a276-d9896d33c010
Sep 04 16:05:52 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:52 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d12a48df-8b66-49a0-a985-6b6d7e9935a9 tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a9c1ec53-85eb-4ed2-a276-d9896d33c010" returned: 0 in 0.576s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d12a48df-8b66-49a0-a985-6b6d7e9935a9 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "cinder-quobyte-a9c1ec53-85eb-4ed2-a276-d9896d33c010" released by "delete_volume" :: held 2.063s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:53 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-74a1ea69-e221-4b45-b31f-a09f090843bf tempest-TestImageHashVerification-39878482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58 /opt/stack/data/cinder/conversion/4b3f4eee-c648-4c2f-a529-8cb086fffb58.temp_image.47dfc582-4116-4a5a-8fa7-9606b6cd0372qjy0qdam.img" returned: 0 in 5.923s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:53 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-d12a48df-8b66-49a0-a985-6b6d7e9935a9 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Created reservations ['96b99ebb-78f4-4436-bdf7-5fdeb2f03810', '33aa0062-8357-4640-8ebd-ef3f30d7294c', '294fa46d-7c4a-4de4-ac31-f6e26924cf4a', 'd78d5d49-41cb-4abf-9fdc-20b6f997260e'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:05:53 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a746d85-c3a8-4d26-9161-12ddf3775107]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:05:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-74a1ea69-e221-4b45-b31f-a09f090843bf tempest-TestImageHashVerification-39878482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d12a48df-8b66-49a0-a985-6b6d7e9935a9 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:05:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d12a48df-8b66-49a0-a985-6b6d7e9935a9 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:05:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d12a48df-8b66-49a0-a985-6b6d7e9935a9 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:05:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d12a48df-8b66-49a0-a985-6b6d7e9935a9 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:05:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d12a48df-8b66-49a0-a985-6b6d7e9935a9 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:05:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d12a48df-8b66-49a0-a985-6b6d7e9935a9 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:05:53 devstack sudo[105693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:05:53 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:53 devstack sudo[105692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58
Sep 04 16:05:53 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:05:53 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d12a48df-8b66-49a0-a985-6b6d7e9935a9 tempest-CreateVolumesFromSourceVolumeTest-296544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.312s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:53 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-d12a48df-8b66-49a0-a985-6b6d7e9935a9 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:05:53 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-d12a48df-8b66-49a0-a985-6b6d7e9935a9 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Deleted volume successfully.
Sep 04 16:05:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d12a48df-8b66-49a0-a985-6b6d7e9935a9 tempest-CreateVolumesFromSourceVolumeTest-296544 None] Lock "cinder-a9c1ec53-85eb-4ed2-a276-d9896d33c010-delete_volume" released by "delete_volume" :: held 2.781s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:05:53 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root
Sep 04 16:05:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-74a1ea69-e221-4b45-b31f-a09f090843bf tempest-TestImageHashVerification-39878482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58" returned: 0 in 0.684s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:05:53 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-74a1ea69-e221-4b45-b31f-a09f090843bf tempest-TestImageHashVerification-39878482 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58, size 1024.00 MB, duration 5.92 sec, destination /opt/stack/data/cinder/conversion/4b3f4eee-c648-4c2f-a529-8cb086fffb58.temp_image.47dfc582-4116-4a5a-8fa7-9606b6cd0372qjy0qdam.img {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 16:05:53 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-74a1ea69-e221-4b45-b31f-a09f090843bf tempest-TestImageHashVerification-39878482 None] Converted 1024.00 MB image at 172.86 MB/s
Sep 04 16:05:53 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-74a1ea69-e221-4b45-b31f-a09f090843bf tempest-TestImageHashVerification-39878482 None] 47dfc582-4116-4a5a-8fa7-9606b6cd0372 was raw, no need to convert to raw {{(pid=87504) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Sep 04 16:05:58 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:05:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Flow 'volume_create_manager' (bf51b9df-9f4e-461c-a4c5-52bd3d341db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:05:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e05e5a-da57-4f4b-8dd0-8ef2489383bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e05e5a-da57-4f4b-8dd0-8ef2489383bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1738611784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c227e0a1-6984-4d00-983e-dd6d5b1bd601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c9d4c69e63f4665ab043f2c5538ba21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:58Z,use_quota=True,user_id='323394e6fdef4c0db881dfdc90791c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b07e22-c108-4084-8b07-8bae174a9403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b07e22-c108-4084-8b07-8bae174a9403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc0cc83-852c-410f-b81d-0b21da67cc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc0cc83-852c-410f-b81d-0b21da67cc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c227e0a1-6984-4d00-983e-dd6d5b1bd601', 'volume_name': 'volume-c227e0a1-6984-4d00-983e-dd6d5b1bd601', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d882c7-984c-4fc3-81ea-8fb734d8edaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d882c7-984c-4fc3-81ea-8fb734d8edaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:05:58 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e4bc6f7-5d97-489e-bde9-3a9fe8dc3ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:05:58 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Volume c227e0a1-6984-4d00-983e-dd6d5b1bd601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c227e0a1-6984-4d00-983e-dd6d5b1bd601', 'volume_size': 1}
Sep 04 16:05:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:06:08 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=34,cinder:UPDATE=51,cinder:INSERT=14,cinder:DELETE=4 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:06:08 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=33,cinder:INSERT=11,cinder:UPDATE=51,cinder:DELETE=3 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:06:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-74a1ea69-e221-4b45-b31f-a09f090843bf tempest-TestImageHashVerification-39878482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.766s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:06:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-74a1ea69-e221-4b45-b31f-a09f090843bf tempest-TestImageHashVerification-39878482 None] Uploaded volume to glance image-id: 47dfc582-4116-4a5a-8fa7-9606b6cd0372. {{(pid=87504) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 04 16:06:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.166s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:06:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1738611784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c227e0a1-6984-4d00-983e-dd6d5b1bd601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c9d4c69e63f4665ab043f2c5538ba21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:58Z,use_quota=True,user_id='323394e6fdef4c0db881dfdc90791c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:06:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Creating volume c227e0a1-6984-4d00-983e-dd6d5b1bd601 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:06:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:06:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:06:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:06:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:06:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:06:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:06:16 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:06:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c227e0a1-6984-4d00-983e-dd6d5b1bd601 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:06:16 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-74a1ea69-e221-4b45-b31f-a09f090843bf tempest-TestImageHashVerification-39878482 None] Copy volume to image completed successfully.
Sep 04 16:06:16 devstack sudo[105759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c227e0a1-6984-4d00-983e-dd6d5b1bd601 1073741824
Sep 04 16:06:16 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:06:17 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root
Sep 04 16:06:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c227e0a1-6984-4d00-983e-dd6d5b1bd601 1073741824" returned: 0 in 0.695s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:06:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c227e0a1-6984-4d00-983e-dd6d5b1bd601 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:06:17 devstack sudo[105792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c227e0a1-6984-4d00-983e-dd6d5b1bd601
Sep 04 16:06:17 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:06:18 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root
Sep 04 16:06:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c227e0a1-6984-4d00-983e-dd6d5b1bd601" returned: 0 in 0.572s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:06:18 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:06:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:06:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e4bc6f7-5d97-489e-bde9-3a9fe8dc3ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c227e0a1-6984-4d00-983e-dd6d5b1bd601', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:06:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a537935f-bc7d-4dfc-838f-801e842d1e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:06:18 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Volume volume-c227e0a1-6984-4d00-983e-dd6d5b1bd601 (c227e0a1-6984-4d00-983e-dd6d5b1bd601): created successfully
Sep 04 16:06:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a537935f-bc7d-4dfc-838f-801e842d1e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:06:18 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Flow 'volume_create_manager' (bf51b9df-9f4e-461c-a4c5-52bd3d341db7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:06:18 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-0d736c4e-ba5b-4c9e-a04b-14b2f3f977df tempest-ProjectReaderTests-1735083212 None] Created volume successfully.
Sep 04 16:06:18 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7dd94894-984e-4c0a-b44c-3fe74ba6ef11 tempest-TestImageHashVerification-39878482 None] Acquiring lock "cinder-4b3f4eee-c648-4c2f-a529-8cb086fffb58-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:06:18 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7dd94894-984e-4c0a-b44c-3fe74ba6ef11 tempest-TestImageHashVerification-39878482 None] Lock "cinder-4b3f4eee-c648-4c2f-a529-8cb086fffb58-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:06:18 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7dd94894-984e-4c0a-b44c-3fe74ba6ef11 tempest-TestImageHashVerification-39878482 None] Acquiring lock "cinder-quobyte-4b3f4eee-c648-4c2f-a529-8cb086fffb58" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:06:18 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7dd94894-984e-4c0a-b44c-3fe74ba6ef11 tempest-TestImageHashVerification-39878482 None] Lock "cinder-quobyte-4b3f4eee-c648-4c2f-a529-8cb086fffb58" acquired by "delete_volume" :: waited 0.029s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:06:18 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae334f9-3101-4c99-81f0-5944799a21db]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:06:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7dd94894-984e-4c0a-b44c-3fe74ba6ef11 tempest-TestImageHashVerification-39878482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:06:19 devstack sudo[105834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58
Sep 04 16:06:19 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:06:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-431ad87f-ec95-42a7-b064-3f2bf494ab96 tempest-ProjectReaderTests-1735083212 None] Acquiring lock "cinder-c227e0a1-6984-4d00-983e-dd6d5b1bd601-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:06:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-431ad87f-ec95-42a7-b064-3f2bf494ab96 tempest-ProjectReaderTests-1735083212 None] Lock "cinder-c227e0a1-6984-4d00-983e-dd6d5b1bd601-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:06:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-431ad87f-ec95-42a7-b064-3f2bf494ab96 tempest-ProjectReaderTests-1735083212 None] Acquiring lock "cinder-quobyte-c227e0a1-6984-4d00-983e-dd6d5b1bd601" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:06:19 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root
Sep 04 16:06:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7dd94894-984e-4c0a-b44c-3fe74ba6ef11 tempest-TestImageHashVerification-39878482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58" returned: 0 in 0.576s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:06:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7dd94894-984e-4c0a-b44c-3fe74ba6ef11 tempest-TestImageHashVerification-39878482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:06:19 devstack sudo[105842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58
Sep 04 16:06:19 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:06:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-431ad87f-ec95-42a7-b064-3f2bf494ab96 tempest-ProjectReaderTests-1735083212 None] Lock "cinder-quobyte-c227e0a1-6984-4d00-983e-dd6d5b1bd601" acquired by "delete_volume" :: waited 0.055s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:06:19 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[975e910f-f29f-4c18-b7fc-baa3a5becd12]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:06:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-431ad87f-ec95-42a7-b064-3f2bf494ab96 tempest-ProjectReaderTests-1735083212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c227e0a1-6984-4d00-983e-dd6d5b1bd601 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:06:19 devstack sudo[105844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c227e0a1-6984-4d00-983e-dd6d5b1bd601
Sep 04 16:06:19 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:06:19 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root
Sep 04 16:06:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7dd94894-984e-4c0a-b44c-3fe74ba6ef11 tempest-TestImageHashVerification-39878482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-4b3f4eee-c648-4c2f-a529-8cb086fffb58" returned: 0 in 0.414s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:06:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7dd94894-984e-4c0a-b44c-3fe74ba6ef11 tempest-TestImageHashVerification-39878482 None] Lock "cinder-quobyte-4b3f4eee-c648-4c2f-a529-8cb086fffb58" released by "delete_volume" :: held 1.077s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:06:20 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-7dd94894-984e-4c0a-b44c-3fe74ba6ef11 tempest-TestImageHashVerification-39878482 None] Created reservations ['86c3aa88-9e12-44b9-a942-f5db973bbb3e', '71ca1293-be19-4607-8e64-f163dbdd4998', 'ba7914a1-9eed-4af9-9c0e-49bf90ef9164', '4d093c0e-e49d-416e-b7fb-0efc01471b6a'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:06:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7dd94894-984e-4c0a-b44c-3fe74ba6ef11 tempest-TestImageHashVerification-39878482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:06:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7dd94894-984e-4c0a-b44c-3fe74ba6ef11 tempest-TestImageHashVerification-39878482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:06:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7dd94894-984e-4c0a-b44c-3fe74ba6ef11 tempest-TestImageHashVerification-39878482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:06:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7dd94894-984e-4c0a-b44c-3fe74ba6ef11 tempest-TestImageHashVerification-39878482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:06:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7dd94894-984e-4c0a-b44c-3fe74ba6ef11 tempest-TestImageHashVerification-39878482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:06:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7dd94894-984e-4c0a-b44c-3fe74ba6ef11 tempest-TestImageHashVerification-39878482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:06:20 devstack sudo[105856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:06:20 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:06:20 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root
Sep 04 16:06:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-431ad87f-ec95-42a7-b064-3f2bf494ab96 tempest-ProjectReaderTests-1735083212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c227e0a1-6984-4d00-983e-dd6d5b1bd601" returned: 0 in 0.601s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:06:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-431ad87f-ec95-42a7-b064-3f2bf494ab96 tempest-ProjectReaderTests-1735083212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c227e0a1-6984-4d00-983e-dd6d5b1bd601 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:06:20 devstack sudo[105858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c227e0a1-6984-4d00-983e-dd6d5b1bd601
Sep 04 16:06:20 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:06:20 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root
Sep 04 16:06:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7dd94894-984e-4c0a-b44c-3fe74ba6ef11 tempest-TestImageHashVerification-39878482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.309s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:06:20 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-7dd94894-984e-4c0a-b44c-3fe74ba6ef11 tempest-TestImageHashVerification-39878482 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:06:20 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-7dd94894-984e-4c0a-b44c-3fe74ba6ef11 tempest-TestImageHashVerification-39878482 None] Deleted volume successfully.
Sep 04 16:06:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7dd94894-984e-4c0a-b44c-3fe74ba6ef11 tempest-TestImageHashVerification-39878482 None] Lock "cinder-4b3f4eee-c648-4c2f-a529-8cb086fffb58-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:06:20 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root
Sep 04 16:06:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-431ad87f-ec95-42a7-b064-3f2bf494ab96 tempest-ProjectReaderTests-1735083212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c227e0a1-6984-4d00-983e-dd6d5b1bd601" returned: 0 in 0.350s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:06:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-431ad87f-ec95-42a7-b064-3f2bf494ab96 tempest-ProjectReaderTests-1735083212 None] Lock "cinder-quobyte-c227e0a1-6984-4d00-983e-dd6d5b1bd601" released by "delete_volume" :: held 1.010s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:06:20 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-431ad87f-ec95-42a7-b064-3f2bf494ab96 tempest-ProjectReaderTests-1735083212 None] Created reservations ['c08d0ddb-af0f-4efe-8721-c8141ecd3ba0', '3e64dd2d-2058-468c-ad09-5ef307f03d9b', 'e6d909f1-57dc-445f-9b99-5b12665f26ca', '15c54bb9-c6de-4d1e-b450-5c0852e7bfdb'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:06:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-431ad87f-ec95-42a7-b064-3f2bf494ab96 tempest-ProjectReaderTests-1735083212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:06:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-431ad87f-ec95-42a7-b064-3f2bf494ab96 tempest-ProjectReaderTests-1735083212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:06:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-431ad87f-ec95-42a7-b064-3f2bf494ab96 tempest-ProjectReaderTests-1735083212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:06:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-431ad87f-ec95-42a7-b064-3f2bf494ab96 tempest-ProjectReaderTests-1735083212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:06:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-431ad87f-ec95-42a7-b064-3f2bf494ab96 tempest-ProjectReaderTests-1735083212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:06:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-431ad87f-ec95-42a7-b064-3f2bf494ab96 tempest-ProjectReaderTests-1735083212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:06:20 devstack sudo[105862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:06:20 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:06:21 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root
Sep 04 16:06:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-431ad87f-ec95-42a7-b064-3f2bf494ab96 tempest-ProjectReaderTests-1735083212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.316s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:06:21 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-431ad87f-ec95-42a7-b064-3f2bf494ab96 tempest-ProjectReaderTests-1735083212 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:06:21 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-431ad87f-ec95-42a7-b064-3f2bf494ab96 tempest-ProjectReaderTests-1735083212 None] Deleted volume successfully.
Sep 04 16:06:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-431ad87f-ec95-42a7-b064-3f2bf494ab96 tempest-ProjectReaderTests-1735083212 None] Lock "cinder-c227e0a1-6984-4d00-983e-dd6d5b1bd601-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:06:22 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:06:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Flow 'volume_create_manager' (bb98e1f0-f9ca-4c49-a1bf-e3a744423d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:06:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27092190-09f4-48e8-815c-af331ddea9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:06:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27092190-09f4-48e8-815c-af331ddea9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-847471629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5254bb4-46ce-41f4-9bf0-d10a958d896d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c9d4c69e63f4665ab043f2c5538ba21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:22Z,use_quota=True,user_id='323394e6fdef4c0db881dfdc90791c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:06:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa624fa-e022-4a65-9271-ccf21e3afa83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:06:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa624fa-e022-4a65-9271-ccf21e3afa83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:06:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (145ad6be-43fc-43f4-af76-2dfffad0f5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:06:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (145ad6be-43fc-43f4-af76-2dfffad0f5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5254bb4-46ce-41f4-9bf0-d10a958d896d', 'volume_name': 'volume-f5254bb4-46ce-41f4-9bf0-d10a958d896d', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:06:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1383195a-7391-49f1-84de-b4bc16f87329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:06:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1383195a-7391-49f1-84de-b4bc16f87329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:06:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2e8c93-1487-4718-a57b-2accd024f76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:06:22 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Volume f5254bb4-46ce-41f4-9bf0-d10a958d896d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5254bb4-46ce-41f4-9bf0-d10a958d896d', 'volume_size': 1}
Sep 04 16:06:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:06:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:06:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-847471629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5254bb4-46ce-41f4-9bf0-d10a958d896d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c9d4c69e63f4665ab043f2c5538ba21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:22Z,use_quota=True,user_id='323394e6fdef4c0db881dfdc90791c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:06:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Creating volume f5254bb4-46ce-41f4-9bf0-d10a958d896d {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:06:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:06:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:06:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:06:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:06:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:06:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:06:22 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:06:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f5254bb4-46ce-41f4-9bf0-d10a958d896d 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:06:22 devstack sudo[105869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f5254bb4-46ce-41f4-9bf0-d10a958d896d 1073741824
Sep 04 16:06:22 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:06:23 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root
Sep 04 16:06:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f5254bb4-46ce-41f4-9bf0-d10a958d896d 1073741824" returned: 0 in 0.519s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:06:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f5254bb4-46ce-41f4-9bf0-d10a958d896d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:06:23 devstack sudo[105876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f5254bb4-46ce-41f4-9bf0-d10a958d896d
Sep 04 16:06:23 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:06:23 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root
Sep 04 16:06:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f5254bb4-46ce-41f4-9bf0-d10a958d896d" returned: 0 in 0.314s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:06:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:06:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:06:23 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2e8c93-1487-4718-a57b-2accd024f76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5254bb4-46ce-41f4-9bf0-d10a958d896d', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:06:23 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c222c655-1724-415d-94fb-d757f3fd2db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:06:23 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Volume volume-f5254bb4-46ce-41f4-9bf0-d10a958d896d (f5254bb4-46ce-41f4-9bf0-d10a958d896d): created successfully
Sep 04 16:06:23 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c222c655-1724-415d-94fb-d757f3fd2db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:06:23 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Flow 'volume_create_manager' (bb98e1f0-f9ca-4c49-a1bf-e3a744423d2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:06:23 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-b0fbede2-e708-4a99-b4fb-dc43dc1b1f06 tempest-ProjectReaderTests-1735083212 None] Created volume successfully.
Sep 04 16:06:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e7ec6fce-2dc9-46bd-a508-260127479f76 tempest-ProjectReaderTests-1735083212 None] Acquiring lock "cinder-f5254bb4-46ce-41f4-9bf0-d10a958d896d-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:06:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e7ec6fce-2dc9-46bd-a508-260127479f76 tempest-ProjectReaderTests-1735083212 None] Lock "cinder-f5254bb4-46ce-41f4-9bf0-d10a958d896d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:06:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e7ec6fce-2dc9-46bd-a508-260127479f76 tempest-ProjectReaderTests-1735083212 None] Acquiring lock "cinder-quobyte-f5254bb4-46ce-41f4-9bf0-d10a958d896d" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:06:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e7ec6fce-2dc9-46bd-a508-260127479f76 tempest-ProjectReaderTests-1735083212 None] Lock "cinder-quobyte-f5254bb4-46ce-41f4-9bf0-d10a958d896d" acquired by "delete_volume" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:06:24 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5332949c-c595-4320-9626-2fe22e429307]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:06:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e7ec6fce-2dc9-46bd-a508-260127479f76 tempest-ProjectReaderTests-1735083212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f5254bb4-46ce-41f4-9bf0-d10a958d896d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:06:24 devstack sudo[105880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f5254bb4-46ce-41f4-9bf0-d10a958d896d
Sep 04 16:06:24 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:06:25 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root
Sep 04 16:06:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e7ec6fce-2dc9-46bd-a508-260127479f76 tempest-ProjectReaderTests-1735083212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f5254bb4-46ce-41f4-9bf0-d10a958d896d" returned: 0 in 0.361s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:06:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e7ec6fce-2dc9-46bd-a508-260127479f76 tempest-ProjectReaderTests-1735083212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f5254bb4-46ce-41f4-9bf0-d10a958d896d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:06:25 devstack sudo[105885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f5254bb4-46ce-41f4-9bf0-d10a958d896d
Sep 04 16:06:25 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:06:25 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root
Sep 04 16:06:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e7ec6fce-2dc9-46bd-a508-260127479f76 tempest-ProjectReaderTests-1735083212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-f5254bb4-46ce-41f4-9bf0-d10a958d896d" returned: 0 in 0.420s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:06:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e7ec6fce-2dc9-46bd-a508-260127479f76 tempest-ProjectReaderTests-1735083212 None] Lock "cinder-quobyte-f5254bb4-46ce-41f4-9bf0-d10a958d896d" released by "delete_volume" :: held 0.831s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:06:25 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-e7ec6fce-2dc9-46bd-a508-260127479f76 tempest-ProjectReaderTests-1735083212 None] Created reservations ['5c5557d4-5279-4cb5-be59-8fbc25ff696c', '65928768-373d-4780-9d6e-2969088b8718', '9132ce42-2be8-4f48-8207-09a9303b7ff4', '349f4e64-9bb6-48f9-8813-05ebe6c269b5'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:06:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e7ec6fce-2dc9-46bd-a508-260127479f76 tempest-ProjectReaderTests-1735083212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:06:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e7ec6fce-2dc9-46bd-a508-260127479f76 tempest-ProjectReaderTests-1735083212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:06:25 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e7ec6fce-2dc9-46bd-a508-260127479f76 tempest-ProjectReaderTests-1735083212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:06:25 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e7ec6fce-2dc9-46bd-a508-260127479f76 tempest-ProjectReaderTests-1735083212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:06:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e7ec6fce-2dc9-46bd-a508-260127479f76 tempest-ProjectReaderTests-1735083212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:06:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e7ec6fce-2dc9-46bd-a508-260127479f76 tempest-ProjectReaderTests-1735083212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:06:25 devstack sudo[105888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:06:25 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:06:26 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root
Sep 04 16:06:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e7ec6fce-2dc9-46bd-a508-260127479f76 tempest-ProjectReaderTests-1735083212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.336s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:06:26 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-e7ec6fce-2dc9-46bd-a508-260127479f76 tempest-ProjectReaderTests-1735083212 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:06:26 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e7ec6fce-2dc9-46bd-a508-260127479f76 tempest-ProjectReaderTests-1735083212 None] Deleted volume successfully.
Sep 04 16:06:26 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e7ec6fce-2dc9-46bd-a508-260127479f76 tempest-ProjectReaderTests-1735083212 None] Lock "cinder-f5254bb4-46ce-41f4-9bf0-d10a958d896d-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:06:36 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=18,cinder:UPDATE=31,cinder:INSERT=10,cinder:DELETE=1 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:06:37 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=20,cinder:UPDATE=30,cinder:DELETE=4,cinder:INSERT=4 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:06:42 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:06:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Flow 'volume_create_manager' (602b65e6-9874-4add-ba64-cf914a7bb6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:06:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0303606-2b9f-40d6-bb8d-ee14d8fa72fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:06:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0303606-2b9f-40d6-bb8d-ee14d8fa72fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-637170903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e47f152667944eb8a40ebdb6cbf8f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:42Z,use_quota=True,user_id='9a86d0a4286a4d7d985ee5a61a5589da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:06:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d60899b9-4612-4180-9ca1-0cc10dfb283e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:06:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d60899b9-4612-4180-9ca1-0cc10dfb283e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:06:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a8cd41-77bf-4ae4-91a4-4ece83419592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:06:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a8cd41-77bf-4ae4-91a4-4ece83419592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f', 'volume_name': 'volume-bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:06:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9945e4-961c-49b4-a261-50264541f4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:06:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9945e4-961c-49b4-a261-50264541f4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:06:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e99908d-8175-4a94-a61e-06d03ad07558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:06:42 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Volume bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f', 'volume_size': 1}
Sep 04 16:06:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:06:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:06:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-637170903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e47f152667944eb8a40ebdb6cbf8f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:42Z,use_quota=True,user_id='9a86d0a4286a4d7d985ee5a61a5589da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:06:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Creating volume bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:06:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:06:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:06:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:06:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:06:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:06:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:06:42 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:06:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:06:42 devstack sudo[105910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f 1073741824
Sep 04 16:06:42 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:06:42 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root
Sep 04 16:06:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f 1073741824" returned: 0 in 0.490s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:06:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:06:43 devstack sudo[105916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f
Sep 04 16:06:43 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:06:43 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root
Sep 04 16:06:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f" returned: 0 in 0.308s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:06:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:06:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:06:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e99908d-8175-4a94-a61e-06d03ad07558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:06:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d78a7d9e-88cd-4414-b8c4-c656c99dad4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:06:43 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Volume volume-bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f (bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f): created successfully
Sep 04 16:06:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d78a7d9e-88cd-4414-b8c4-c656c99dad4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:06:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Flow 'volume_create_manager' (602b65e6-9874-4add-ba64-cf914a7bb6ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:06:43 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-cdbd154c-2b19-4e05-8b8a-56123f240344 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Created volume successfully.
Sep 04 16:06:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-6193eb70-c43f-4acf-b0a9-e06f3cc1e518 req-94a0c758-568c-404d-9c04-8f8cdd58ca2b tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:06:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-6193eb70-c43f-4acf-b0a9-e06f3cc1e518 req-94a0c758-568c-404d-9c04-8f8cdd58ca2b tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:06:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [req-6193eb70-c43f-4acf-b0a9-e06f3cc1e518 req-94a0c758-568c-404d-9c04-8f8cdd58ca2b tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:06:45 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-6193eb70-c43f-4acf-b0a9-e06f3cc1e518 req-94a0c758-568c-404d-9c04-8f8cdd58ca2b tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236', 'name': 'volume-bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d5352e6-2d68-404d-b218-d4bfba03df7a', 'enforce_multipath': True} {{(pid=87504) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 16:06:45 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-6193eb70-c43f-4acf-b0a9-e06f3cc1e518 req-94a0c758-568c-404d-9c04-8f8cdd58ca2b tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] attachment_update completed successfully.
Sep 04 16:06:48 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 16:06:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:06:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:06:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:06:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:06:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:06:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:06:48 devstack sudo[106321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:06:48 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:06:49 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root
Sep 04 16:06:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.297s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:06:49 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:06:49 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager._thread_info {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 16:06:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread count: 28 {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 16:06:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread info: [<_MainThread(MainThread, started 131673838448768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131673724603200)>, <Thread(Thread-3 (stat_writer), started daemon 131673723495936)>, <Thread(Rabbit-heartbeat, started daemon 131673723764800)>, <Thread(Thread-5 (_runner), started daemon 131673722269632)>, <Thread(Thread-7 (_runner), started daemon 131673722322112)>, <Thread(fd_logger, started daemon 131673722585024)>, <Thread(privsep_reader, started daemon 131673721593984)>, <Thread(tpool_thread_0, started daemon 131673714706112)>, <Thread(tpool_thread_1, started daemon 131673706313408)>, <Thread(tpool_thread_2, started daemon 131673697920704)>, <Thread(tpool_thread_3, started daemon 131673689528000)>, <Thread(tpool_thread_4, started daemon 131673681135296)>, <Thread(tpool_thread_5, started daemon 131673672726208)>, <Thread(tpool_thread_6, started daemon 131673664317120)>, <Thread(tpool_thread_7, started daemon 131673655908032)>, <Thread(tpool_thread_8, started daemon 131673647498944)>, <Thread(tpool_thread_9, started daemon 131673639089856)>, <Thread(tpool_thread_10, started daemon 131673630680768)>, <Thread(tpool_thread_11, started daemon 131673622271680)>, <Thread(tpool_thread_12, started daemon 131673613862592)>, <Thread(tpool_thread_13, started daemon 131673605453504)>, <Thread(tpool_thread_14, started daemon 131673597044416)>, <Thread(tpool_thread_15, started daemon 131673588635328)>, <Thread(tpool_thread_16, started daemon 131673580226240)>, <Thread(tpool_thread_17, started daemon 131673571817152)>, <Thread(tpool_thread_18, started daemon 131673563408064)>, <Thread(tpool_thread_19, started daemon 131673554998976)>] {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 16:06:49 devstack cinder-volume[87504]: INFO cinder.volume.manager [req-5a54f8ba-6b8d-49c0-9abf-5f8a486d6cdf req-857d5e80-c797-437e-a052-4f404ac5260c tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Terminate volume connection completed successfully.
Sep 04 16:06:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [req-5a54f8ba-6b8d-49c0-9abf-5f8a486d6cdf req-857d5e80-c797-437e-a052-4f404ac5260c tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Deleting attachment 7d5352e6-2d68-404d-b218-d4bfba03df7a. {{(pid=87504) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 16:06:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-934fa9d9-fde8-4e85-a271-2e3f99be4147 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Acquiring lock "cinder-bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:06:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-934fa9d9-fde8-4e85-a271-2e3f99be4147 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Lock "cinder-bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:06:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-934fa9d9-fde8-4e85-a271-2e3f99be4147 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Acquiring lock "cinder-quobyte-bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:06:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-934fa9d9-fde8-4e85-a271-2e3f99be4147 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Lock "cinder-quobyte-bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:06:50 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f11835a-d029-4586-915b-bcef5c53c2df]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:06:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-934fa9d9-fde8-4e85-a271-2e3f99be4147 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:06:50 devstack sudo[106352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f
Sep 04 16:06:50 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:06:50 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root
Sep 04 16:06:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-934fa9d9-fde8-4e85-a271-2e3f99be4147 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f" returned: 0 in 0.375s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:06:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-934fa9d9-fde8-4e85-a271-2e3f99be4147 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:06:50 devstack sudo[106357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f
Sep 04 16:06:50 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:06:50 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root
Sep 04 16:06:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-934fa9d9-fde8-4e85-a271-2e3f99be4147 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f" returned: 0 in 0.253s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:06:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-934fa9d9-fde8-4e85-a271-2e3f99be4147 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Lock "cinder-quobyte-bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f" released by "delete_volume" :: held 0.675s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:06:50 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-934fa9d9-fde8-4e85-a271-2e3f99be4147 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Created reservations ['c1a09d78-1037-4a14-b88d-35a82170e4d1', 'a6480a7b-64c7-4f46-bf24-b08d802c3bf6', 'd549f6c2-d6ea-4a8a-bf54-04d0529f043c', 'c6ef936a-6fa1-4eb5-82f6-c6ed149153ed'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:06:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-934fa9d9-fde8-4e85-a271-2e3f99be4147 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:06:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-934fa9d9-fde8-4e85-a271-2e3f99be4147 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:06:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-934fa9d9-fde8-4e85-a271-2e3f99be4147 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:06:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-934fa9d9-fde8-4e85-a271-2e3f99be4147 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:06:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-934fa9d9-fde8-4e85-a271-2e3f99be4147 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:06:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-934fa9d9-fde8-4e85-a271-2e3f99be4147 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:06:50 devstack sudo[106360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:06:50 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:06:51 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root
Sep 04 16:06:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-934fa9d9-fde8-4e85-a271-2e3f99be4147 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.262s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:06:51 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-934fa9d9-fde8-4e85-a271-2e3f99be4147 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:06:51 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-934fa9d9-fde8-4e85-a271-2e3f99be4147 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Deleted volume successfully.
Sep 04 16:06:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-934fa9d9-fde8-4e85-a271-2e3f99be4147 tempest-TestServerVolumeAttachScenarioOldVersion-1364782614 None] Lock "cinder-bb7c1fd1-cfe7-46ee-9fe5-c886a6b7844f-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:06:59 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:06:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Flow 'volume_create_manager' (ac18cc21-c844-45c3-8fa2-846ef3615ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:06:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de10bd6c-c356-4f2a-80ff-43b690fea43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:06:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de10bd6c-c356-4f2a-80ff-43b690fea43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-867460278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=458ef29a-a85c-4b02-baf7-238383804648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10416811c81d4c2594fba7fa07094af6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:00Z,use_quota=True,user_id='7b1d1ed23f5844b3a90d8feb1bdc6444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:06:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e682e64-9169-471a-b8f3-3bc34a1cfa65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:06:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e682e64-9169-471a-b8f3-3bc34a1cfa65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:06:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa59bc67-9960-4b21-a028-deec96c4c207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:06:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa59bc67-9960-4b21-a028-deec96c4c207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '458ef29a-a85c-4b02-baf7-238383804648', 'volume_name': 'volume-458ef29a-a85c-4b02-baf7-238383804648', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:06:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72086a4e-c44d-4cc3-aa13-66b6bfc2e434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:06:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72086a4e-c44d-4cc3-aa13-66b6bfc2e434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:06:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f95d745-393f-47d8-b0fa-bd9948fa6404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:06:59 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Volume 458ef29a-a85c-4b02-baf7-238383804648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-458ef29a-a85c-4b02-baf7-238383804648', 'volume_size': 1}
Sep 04 16:06:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:06:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:06:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-867460278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=458ef29a-a85c-4b02-baf7-238383804648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10416811c81d4c2594fba7fa07094af6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:00Z,use_quota=True,user_id='7b1d1ed23f5844b3a90d8feb1bdc6444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:06:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Creating volume 458ef29a-a85c-4b02-baf7-238383804648 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:06:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:06:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:06:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:06:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:06:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:06:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:06:59 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:06:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:06:59 devstack sudo[106389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648 1073741824
Sep 04 16:06:59 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:00 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648 1073741824" returned: 0 in 0.486s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:00 devstack sudo[106395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648
Sep 04 16:07:00 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:00 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648" returned: 0 in 0.252s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:07:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f95d745-393f-47d8-b0fa-bd9948fa6404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-458ef29a-a85c-4b02-baf7-238383804648', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e7a7f6-b747-4aa0-a391-4f365a3f7a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:00 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Volume volume-458ef29a-a85c-4b02-baf7-238383804648 (458ef29a-a85c-4b02-baf7-238383804648): created successfully
Sep 04 16:07:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e7a7f6-b747-4aa0-a391-4f365a3f7a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Flow 'volume_create_manager' (ac18cc21-c844-45c3-8fa2-846ef3615ef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:00 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-7a30efa8-38dd-4984-af0a-4adbd258c70d tempest-SnapshotDependencyTests-70948626 None] Created volume successfully.
Sep 04 16:07:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-34cd27ee-1be5-467b-bf52-0e5e606a9b88 tempest-SnapshotDependencyTests-70948626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-34cd27ee-1be5-467b-bf52-0e5e606a9b88 tempest-SnapshotDependencyTests-70948626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:02 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-34cd27ee-1be5-467b-bf52-0e5e606a9b88 tempest-SnapshotDependencyTests-70948626 None] Creating offline snapshot 1b601185-c7dd-4b18-a085-ea3129b7c060 of volume 458ef29a-a85c-4b02-baf7-238383804648 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 16:07:02 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b765ea7-b5a1-4c96-aa35-e56a3554ba79]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-34cd27ee-1be5-467b-bf52-0e5e606a9b88 tempest-SnapshotDependencyTests-70948626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:02 devstack sudo[106399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648
Sep 04 16:07:02 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:02 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-34cd27ee-1be5-467b-bf52-0e5e606a9b88 tempest-SnapshotDependencyTests-70948626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648" returned: 0 in 0.369s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-34cd27ee-1be5-467b-bf52-0e5e606a9b88 tempest-SnapshotDependencyTests-70948626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.1b601185-c7dd-4b18-a085-ea3129b7c060 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:02 devstack sudo[106404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.1b601185-c7dd-4b18-a085-ea3129b7c060 1G
Sep 04 16:07:02 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:03 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-34cd27ee-1be5-467b-bf52-0e5e606a9b88 tempest-SnapshotDependencyTests-70948626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.1b601185-c7dd-4b18-a085-ea3129b7c060 1G" returned: 0 in 0.447s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-34cd27ee-1be5-467b-bf52-0e5e606a9b88 tempest-SnapshotDependencyTests-70948626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-458ef29a-a85c-4b02-baf7-238383804648 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.1b601185-c7dd-4b18-a085-ea3129b7c060 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:03 devstack sudo[106409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-458ef29a-a85c-4b02-baf7-238383804648 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.1b601185-c7dd-4b18-a085-ea3129b7c060
Sep 04 16:07:03 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:03 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-34cd27ee-1be5-467b-bf52-0e5e606a9b88 tempest-SnapshotDependencyTests-70948626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-458ef29a-a85c-4b02-baf7-238383804648 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.1b601185-c7dd-4b18-a085-ea3129b7c060" returned: 0 in 0.315s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:03 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-34cd27ee-1be5-467b-bf52-0e5e606a9b88 tempest-SnapshotDependencyTests-70948626 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.1b601185-c7dd-4b18-a085-ea3129b7c060 is being set with open permissions: ugo+rw
Sep 04 16:07:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-34cd27ee-1be5-467b-bf52-0e5e606a9b88 tempest-SnapshotDependencyTests-70948626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.1b601185-c7dd-4b18-a085-ea3129b7c060 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:03 devstack sudo[106414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.1b601185-c7dd-4b18-a085-ea3129b7c060
Sep 04 16:07:03 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:03 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-34cd27ee-1be5-467b-bf52-0e5e606a9b88 tempest-SnapshotDependencyTests-70948626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.1b601185-c7dd-4b18-a085-ea3129b7c060" returned: 0 in 0.260s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-34cd27ee-1be5-467b-bf52-0e5e606a9b88 tempest-SnapshotDependencyTests-70948626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:03 devstack sudo[106418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.info
Sep 04 16:07:03 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:03 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-34cd27ee-1be5-467b-bf52-0e5e606a9b88 tempest-SnapshotDependencyTests-70948626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.info" returned: 0 in 0.256s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:03 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-34cd27ee-1be5-467b-bf52-0e5e606a9b88 tempest-SnapshotDependencyTests-70948626 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.info is being set with open permissions: ugo+rw
Sep 04 16:07:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-34cd27ee-1be5-467b-bf52-0e5e606a9b88 tempest-SnapshotDependencyTests-70948626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:03 devstack sudo[106421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.info
Sep 04 16:07:03 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:04 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-34cd27ee-1be5-467b-bf52-0e5e606a9b88 tempest-SnapshotDependencyTests-70948626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.info" returned: 0 in 0.241s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-34cd27ee-1be5-467b-bf52-0e5e606a9b88 tempest-SnapshotDependencyTests-70948626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.987s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:04 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-34cd27ee-1be5-467b-bf52-0e5e606a9b88 tempest-SnapshotDependencyTests-70948626 None] Create snapshot completed successfully
Sep 04 16:07:04 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:07:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Flow 'volume_create_manager' (c7a18aac-e00d-46bb-be5f-a5a66c90155e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56e20c8-994b-49d0-9b65-e6f51ba64b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56e20c8-994b-49d0-9b65-e6f51ba64b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8389868-0db7-4411-be65-597e2815f10f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10416811c81d4c2594fba7fa07094af6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1b601185-c7dd-4b18-a085-ea3129b7c060,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:05Z,use_quota=True,user_id='7b1d1ed23f5844b3a90d8feb1bdc6444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764d6cb4-64cf-494d-a2c2-4110ba5f994f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764d6cb4-64cf-494d-a2c2-4110ba5f994f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07692733-0c0f-4b0c-b501-7287675aaf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07692733-0c0f-4b0c-b501-7287675aaf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e8389868-0db7-4411-be65-597e2815f10f', 'volume_name': 'volume-e8389868-0db7-4411-be65-597e2815f10f', 'volume_size': 1, 'snapshot_id': '1b601185-c7dd-4b18-a085-ea3129b7c060'}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8fa4ac8-738c-4894-b532-2ce7566e1f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8fa4ac8-738c-4894-b532-2ce7566e1f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:04 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce2ec98-9050-477e-9309-b5893a07b57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:04 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Volume e8389868-0db7-4411-be65-597e2815f10f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e8389868-0db7-4411-be65-597e2815f10f', 'volume_size': 1, 'snapshot_id': '1b601185-c7dd-4b18-a085-ea3129b7c060'}
Sep 04 16:07:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:04 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Acquiring lock "cinder-quobyte-1b601185-c7dd-4b18-a085-ea3129b7c060-e8389868-0db7-4411-be65-597e2815f10f" by "_create_volume_from_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Lock "cinder-quobyte-1b601185-c7dd-4b18-a085-ea3129b7c060-e8389868-0db7-4411-be65-597e2815f10f" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Creating volume e8389868-0db7-4411-be65-597e2815f10f from snapshot 1b601185-c7dd-4b18-a085-ea3129b7c060 {{(pid=87504) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Acquiring lock "cinder-quobyte-e8389868-0db7-4411-be65-597e2815f10f" by "_copy_volume_from_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Lock "cinder-quobyte-e8389868-0db7-4411-be65-597e2815f10f" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] snapshot: 1b601185-c7dd-4b18-a085-ea3129b7c060, volume: e8389868-0db7-4411-be65-597e2815f10f,  {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[298d6fde-6135-41dc-9897-017123eabf9e]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.1b601185-c7dd-4b18-a085-ea3129b7c060 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:05 devstack sudo[106425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.1b601185-c7dd-4b18-a085-ea3129b7c060
Sep 04 16:07:05 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:05 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.1b601185-c7dd-4b18-a085-ea3129b7c060" returned: 0 in 0.462s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-458ef29a-a85c-4b02-baf7-238383804648(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1f4b42-c2e5-4341-9cb0-613e839ff99e]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:05 devstack sudo[106430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648
Sep 04 16:07:05 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:05 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648" returned: 0 in 0.389s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648 {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Creating direct copy from snapshot {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG cinder.utils [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Path /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e8389868-0db7-4411-be65-597e2815f10f not found in is_blk_device check {{(pid=87504) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 04 16:07:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e8389868-0db7-4411-be65-597e2815f10f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:05 devstack sudo[106435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e8389868-0db7-4411-be65-597e2815f10f
Sep 04 16:07:05 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:10 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e8389868-0db7-4411-be65-597e2815f10f" returned: 0 in 4.969s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:10 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648, size 1024.00 MB, duration 4.97 sec, destination /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e8389868-0db7-4411-be65-597e2815f10f {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 16:07:10 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Converted 1024.00 MB image at 206.02 MB/s
Sep 04 16:07:10 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e8389868-0db7-4411-be65-597e2815f10f is being set with open permissions: ugo+rw
Sep 04 16:07:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e8389868-0db7-4411-be65-597e2815f10f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:10 devstack sudo[106485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e8389868-0db7-4411-be65-597e2815f10f
Sep 04 16:07:10 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:11 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e8389868-0db7-4411-be65-597e2815f10f" returned: 0 in 0.261s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:11 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Lock "cinder-quobyte-e8389868-0db7-4411-be65-597e2815f10f" released by "_copy_volume_from_snapshot" :: held 6.162s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:11 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Lock "cinder-quobyte-1b601185-c7dd-4b18-a085-ea3129b7c060-e8389868-0db7-4411-be65-597e2815f10f" released by "_create_volume_from_snapshot" :: held 6.223s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.237s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce2ec98-9050-477e-9309-b5893a07b57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8389868-0db7-4411-be65-597e2815f10f', 'volume_size': 1, 'snapshot_id': '1b601185-c7dd-4b18-a085-ea3129b7c060'}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeaa07cf-6db2-4223-8605-0b1bc349460d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:11 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Volume volume-e8389868-0db7-4411-be65-597e2815f10f (e8389868-0db7-4411-be65-597e2815f10f): created successfully
Sep 04 16:07:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeaa07cf-6db2-4223-8605-0b1bc349460d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:11 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Flow 'volume_create_manager' (c7a18aac-e00d-46bb-be5f-a5a66c90155e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:11 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-c53f2daf-0b40-4a84-8cd7-26f6520fab02 tempest-SnapshotDependencyTests-70948626 None] Created volume successfully.
Sep 04 16:07:11 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f6b14c43-b583-46c3-b037-479ab1bf12fe tempest-SnapshotDependencyTests-70948626 None] Acquiring lock "cinder-1b601185-c7dd-4b18-a085-ea3129b7c060-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:11 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f6b14c43-b583-46c3-b037-479ab1bf12fe tempest-SnapshotDependencyTests-70948626 None] Lock "cinder-1b601185-c7dd-4b18-a085-ea3129b7c060-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:11 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f6b14c43-b583-46c3-b037-479ab1bf12fe tempest-SnapshotDependencyTests-70948626 None] Acquiring lock "cinder-quobyte-458ef29a-a85c-4b02-baf7-238383804648" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:11 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f6b14c43-b583-46c3-b037-479ab1bf12fe tempest-SnapshotDependencyTests-70948626 None] Lock "cinder-quobyte-458ef29a-a85c-4b02-baf7-238383804648" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:11 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f6b14c43-b583-46c3-b037-479ab1bf12fe tempest-SnapshotDependencyTests-70948626 None] Acquiring lock "cinder-quobyte-1b601185-c7dd-4b18-a085-ea3129b7c060" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:11 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f6b14c43-b583-46c3-b037-479ab1bf12fe tempest-SnapshotDependencyTests-70948626 None] Lock "cinder-quobyte-1b601185-c7dd-4b18-a085-ea3129b7c060" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-f6b14c43-b583-46c3-b037-479ab1bf12fe tempest-SnapshotDependencyTests-70948626 None] Deleting offline snapshot 1b601185-c7dd-4b18-a085-ea3129b7c060 of volume 458ef29a-a85c-4b02-baf7-238383804648 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 16:07:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-f6b14c43-b583-46c3-b037-479ab1bf12fe tempest-SnapshotDependencyTests-70948626 None] snapshot_file for this snap is: volume-458ef29a-a85c-4b02-baf7-238383804648.1b601185-c7dd-4b18-a085-ea3129b7c060 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 16:07:11 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f691f9-b4f9-40d4-826b-28388f6cc2c7]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f6b14c43-b583-46c3-b037-479ab1bf12fe tempest-SnapshotDependencyTests-70948626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.1b601185-c7dd-4b18-a085-ea3129b7c060 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:12 devstack sudo[106488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.1b601185-c7dd-4b18-a085-ea3129b7c060
Sep 04 16:07:12 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:12 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f6b14c43-b583-46c3-b037-479ab1bf12fe tempest-SnapshotDependencyTests-70948626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.1b601185-c7dd-4b18-a085-ea3129b7c060" returned: 0 in 0.369s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-f6b14c43-b583-46c3-b037-479ab1bf12fe tempest-SnapshotDependencyTests-70948626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-458ef29a-a85c-4b02-baf7-238383804648(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:07:12 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fd943c-aabd-4316-a160-ae0c05afdbe3]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f6b14c43-b583-46c3-b037-479ab1bf12fe tempest-SnapshotDependencyTests-70948626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:12 devstack sudo[106493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648
Sep 04 16:07:12 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:12 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f6b14c43-b583-46c3-b037-479ab1bf12fe tempest-SnapshotDependencyTests-70948626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648" returned: 0 in 0.541s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f6b14c43-b583-46c3-b037-479ab1bf12fe tempest-SnapshotDependencyTests-70948626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.1b601185-c7dd-4b18-a085-ea3129b7c060 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:12 devstack sudo[106498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.1b601185-c7dd-4b18-a085-ea3129b7c060
Sep 04 16:07:12 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:13 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f6b14c43-b583-46c3-b037-479ab1bf12fe tempest-SnapshotDependencyTests-70948626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.1b601185-c7dd-4b18-a085-ea3129b7c060" returned: 0 in 0.363s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f6b14c43-b583-46c3-b037-479ab1bf12fe tempest-SnapshotDependencyTests-70948626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.1b601185-c7dd-4b18-a085-ea3129b7c060 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:13 devstack sudo[106504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.1b601185-c7dd-4b18-a085-ea3129b7c060
Sep 04 16:07:13 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:13 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f6b14c43-b583-46c3-b037-479ab1bf12fe tempest-SnapshotDependencyTests-70948626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648.1b601185-c7dd-4b18-a085-ea3129b7c060" returned: 0 in 0.257s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f6b14c43-b583-46c3-b037-479ab1bf12fe tempest-SnapshotDependencyTests-70948626 None] Lock "cinder-quobyte-1b601185-c7dd-4b18-a085-ea3129b7c060" released by "_delete_snapshot" :: held 1.644s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f6b14c43-b583-46c3-b037-479ab1bf12fe tempest-SnapshotDependencyTests-70948626 None] Lock "cinder-quobyte-458ef29a-a85c-4b02-baf7-238383804648" released by "delete_snapshot" :: held 1.664s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:13 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-f6b14c43-b583-46c3-b037-479ab1bf12fe tempest-SnapshotDependencyTests-70948626 None] Created reservations ['f3b30a9b-2d6b-45ad-98f2-0929b83392d4', 'c751419c-b77e-4219-bbd3-6fe0daeb3e10', 'f36aa552-8068-4968-8574-b810aba3f51d', '7977d4eb-b4d2-4bc0-b48b-0fef47635eda'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:07:13 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f6b14c43-b583-46c3-b037-479ab1bf12fe tempest-SnapshotDependencyTests-70948626 None] Delete snapshot completed successfully.
Sep 04 16:07:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f6b14c43-b583-46c3-b037-479ab1bf12fe tempest-SnapshotDependencyTests-70948626 None] Lock "cinder-1b601185-c7dd-4b18-a085-ea3129b7c060-delete_snapshot" released by "delete_snapshot" :: held 1.824s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4e0b29e2-05da-4f54-8377-476027541de0 tempest-SnapshotDependencyTests-70948626 None] Acquiring lock "cinder-458ef29a-a85c-4b02-baf7-238383804648-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4e0b29e2-05da-4f54-8377-476027541de0 tempest-SnapshotDependencyTests-70948626 None] Lock "cinder-458ef29a-a85c-4b02-baf7-238383804648-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4e0b29e2-05da-4f54-8377-476027541de0 tempest-SnapshotDependencyTests-70948626 None] Acquiring lock "cinder-quobyte-458ef29a-a85c-4b02-baf7-238383804648" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4e0b29e2-05da-4f54-8377-476027541de0 tempest-SnapshotDependencyTests-70948626 None] Lock "cinder-quobyte-458ef29a-a85c-4b02-baf7-238383804648" acquired by "delete_volume" :: waited 0.017s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:14 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3feb0e7-f9ab-405b-9c6d-bfbc51329805]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4e0b29e2-05da-4f54-8377-476027541de0 tempest-SnapshotDependencyTests-70948626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:14 devstack sudo[106507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648
Sep 04 16:07:14 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:14 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4e0b29e2-05da-4f54-8377-476027541de0 tempest-SnapshotDependencyTests-70948626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648" returned: 0 in 0.384s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4e0b29e2-05da-4f54-8377-476027541de0 tempest-SnapshotDependencyTests-70948626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:14 devstack sudo[106513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648
Sep 04 16:07:14 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:14 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4e0b29e2-05da-4f54-8377-476027541de0 tempest-SnapshotDependencyTests-70948626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-458ef29a-a85c-4b02-baf7-238383804648" returned: 0 in 0.256s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4e0b29e2-05da-4f54-8377-476027541de0 tempest-SnapshotDependencyTests-70948626 None] Lock "cinder-quobyte-458ef29a-a85c-4b02-baf7-238383804648" released by "delete_volume" :: held 0.707s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:14 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-4e0b29e2-05da-4f54-8377-476027541de0 tempest-SnapshotDependencyTests-70948626 None] Created reservations ['add9031d-a029-44c1-8e58-5a04b6ddd6a9', 'aea2f74c-cc26-4ed3-951b-0c8fcadc4f28', '6b7c0f1d-4248-4cce-b911-9401e209ecef', 'a2671f62-9a67-4142-a134-cc5fb203b665'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:07:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4e0b29e2-05da-4f54-8377-476027541de0 tempest-SnapshotDependencyTests-70948626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4e0b29e2-05da-4f54-8377-476027541de0 tempest-SnapshotDependencyTests-70948626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:14 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4e0b29e2-05da-4f54-8377-476027541de0 tempest-SnapshotDependencyTests-70948626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:15 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4e0b29e2-05da-4f54-8377-476027541de0 tempest-SnapshotDependencyTests-70948626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4e0b29e2-05da-4f54-8377-476027541de0 tempest-SnapshotDependencyTests-70948626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4e0b29e2-05da-4f54-8377-476027541de0 tempest-SnapshotDependencyTests-70948626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:15 devstack sudo[106516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:07:15 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:15 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4e0b29e2-05da-4f54-8377-476027541de0 tempest-SnapshotDependencyTests-70948626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.268s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:15 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-4e0b29e2-05da-4f54-8377-476027541de0 tempest-SnapshotDependencyTests-70948626 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:07:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4c2b8c8e-4f23-45c2-be0e-1310f7c917b6 tempest-SnapshotDependencyTests-70948626 None] Acquiring lock "cinder-e8389868-0db7-4411-be65-597e2815f10f-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:15 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-4e0b29e2-05da-4f54-8377-476027541de0 tempest-SnapshotDependencyTests-70948626 None] Deleted volume successfully.
Sep 04 16:07:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4c2b8c8e-4f23-45c2-be0e-1310f7c917b6 tempest-SnapshotDependencyTests-70948626 None] Lock "cinder-e8389868-0db7-4411-be65-597e2815f10f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4e0b29e2-05da-4f54-8377-476027541de0 tempest-SnapshotDependencyTests-70948626 None] Lock "cinder-458ef29a-a85c-4b02-baf7-238383804648-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4c2b8c8e-4f23-45c2-be0e-1310f7c917b6 tempest-SnapshotDependencyTests-70948626 None] Acquiring lock "cinder-quobyte-e8389868-0db7-4411-be65-597e2815f10f" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4c2b8c8e-4f23-45c2-be0e-1310f7c917b6 tempest-SnapshotDependencyTests-70948626 None] Lock "cinder-quobyte-e8389868-0db7-4411-be65-597e2815f10f" acquired by "delete_volume" :: waited 0.016s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:15 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[549d6f3a-2351-4818-b4a5-25f014d7d161]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4c2b8c8e-4f23-45c2-be0e-1310f7c917b6 tempest-SnapshotDependencyTests-70948626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e8389868-0db7-4411-be65-597e2815f10f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:15 devstack sudo[106519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e8389868-0db7-4411-be65-597e2815f10f
Sep 04 16:07:15 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:15 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4c2b8c8e-4f23-45c2-be0e-1310f7c917b6 tempest-SnapshotDependencyTests-70948626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e8389868-0db7-4411-be65-597e2815f10f" returned: 0 in 0.379s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4c2b8c8e-4f23-45c2-be0e-1310f7c917b6 tempest-SnapshotDependencyTests-70948626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e8389868-0db7-4411-be65-597e2815f10f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:15 devstack sudo[106524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e8389868-0db7-4411-be65-597e2815f10f
Sep 04 16:07:15 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:16 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4c2b8c8e-4f23-45c2-be0e-1310f7c917b6 tempest-SnapshotDependencyTests-70948626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e8389868-0db7-4411-be65-597e2815f10f" returned: 0 in 0.293s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Flow 'volume_create_manager' (f5793cf3-ccff-4747-8cf7-a652832b3e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb977ab1-21df-4979-9821-d306824980cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4c2b8c8e-4f23-45c2-be0e-1310f7c917b6 tempest-SnapshotDependencyTests-70948626 None] Lock "cinder-quobyte-e8389868-0db7-4411-be65-597e2815f10f" released by "delete_volume" :: held 0.752s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb977ab1-21df-4979-9821-d306824980cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1380d126-8311-4a88-bc10-f105107ac9c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d843498e4eca417f9535674922664cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:16Z,use_quota=True,user_id='630362273e8d4ee5a239db88a8ddcded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd819bee-288b-41b2-aa01-0df33d254fad),volume_type_id=bd819bee-288b-41b2-aa01-0df33d254fad)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e98dfc7-6c43-4447-a5f7-c5b1d199a3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e98dfc7-6c43-4447-a5f7-c5b1d199a3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c790754b-e0dc-454d-a203-9a10c5923fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG cinder.image.glance [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Creating Keystone auth plugin from conf {{(pid=87504) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-4c2b8c8e-4f23-45c2-be0e-1310f7c917b6 tempest-SnapshotDependencyTests-70948626 None] Created reservations ['7ce5167d-29b6-4791-8bca-6dde835516a1', '732f4834-6784-4ea1-93f6-9d93231a76c9', 'a0bd29fd-95df-45cd-b4d1-901ff9493eca', '343cb3ec-c20d-4909-850e-04dc363d39bd'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4c2b8c8e-4f23-45c2-be0e-1310f7c917b6 tempest-SnapshotDependencyTests-70948626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4c2b8c8e-4f23-45c2-be0e-1310f7c917b6 tempest-SnapshotDependencyTests-70948626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4c2b8c8e-4f23-45c2-be0e-1310f7c917b6 tempest-SnapshotDependencyTests-70948626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4c2b8c8e-4f23-45c2-be0e-1310f7c917b6 tempest-SnapshotDependencyTests-70948626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4c2b8c8e-4f23-45c2-be0e-1310f7c917b6 tempest-SnapshotDependencyTests-70948626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4c2b8c8e-4f23-45c2-be0e-1310f7c917b6 tempest-SnapshotDependencyTests-70948626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:16 devstack sudo[106527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:07:16 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c790754b-e0dc-454d-a203-9a10c5923fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1380d126-8311-4a88-bc10-f105107ac9c2', 'volume_name': 'volume-1380d126-8311-4a88-bc10-f105107ac9c2', 'volume_size': 1, 'image_id': 'afc4e125-f75e-45fc-b66e-3d0061cf1b90', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/afc4e125-f75e-45fc-b66e-3d0061cf1b90', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '85fd4c4a792e67411ba0833a6f5d7f10', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd843498e4eca417f9535674922664cfc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '96dcde062d5e2470f9ed2d8cf6976913ee362e18e07a446594880c17bebdc559fdc8b4515c61dea203755a8b6bd63c8d907046ea7ee3d3b3f417f2cc33eef128', 'id': 'afc4e125-f75e-45fc-b66e-3d0061cf1b90', 'created_at': datetime.datetime(2026, 9, 4, 14, 7, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 7, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afc4e125-f75e-45fc-b66e-3d0061cf1b90/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1ad18d160>}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f5cee6-f3c2-4fdd-9485-3fca0a02c512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f5cee6-f3c2-4fdd-9485-3fca0a02c512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ecc6fca-2bfd-4623-bc1b-b07f7799acb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:16 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Volume 1380d126-8311-4a88-bc10-f105107ac9c2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1380d126-8311-4a88-bc10-f105107ac9c2', 'volume_size': 1, 'image_id': 'afc4e125-f75e-45fc-b66e-3d0061cf1b90', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/afc4e125-f75e-45fc-b66e-3d0061cf1b90', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '85fd4c4a792e67411ba0833a6f5d7f10', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd843498e4eca417f9535674922664cfc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '96dcde062d5e2470f9ed2d8cf6976913ee362e18e07a446594880c17bebdc559fdc8b4515c61dea203755a8b6bd63c8d907046ea7ee3d3b3f417f2cc33eef128', 'id': 'afc4e125-f75e-45fc-b66e-3d0061cf1b90', 'created_at': datetime.datetime(2026, 9, 4, 14, 7, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 7, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afc4e125-f75e-45fc-b66e-3d0061cf1b90/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1ad18d160>}
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Trying to clone 1380d126-8311-4a88-bc10-f105107ac9c2 from image afc4e125-f75e-45fc-b66e-3d0061cf1b90 at location (None, [{'url': 'file:///opt/stack/data/glance/images/afc4e125-f75e-45fc-b66e-3d0061cf1b90', 'metadata': {}}]). {{(pid=87504) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 04 16:07:16 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Image download 0.00 MB at 0.00 MB/s
Sep 04 16:07:16 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4c2b8c8e-4f23-45c2-be0e-1310f7c917b6 tempest-SnapshotDependencyTests-70948626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.306s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-4c2b8c8e-4f23-45c2-be0e-1310f7c917b6 tempest-SnapshotDependencyTests-70948626 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:07:16 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-4c2b8c8e-4f23-45c2-be0e-1310f7c917b6 tempest-SnapshotDependencyTests-70948626 None] Deleted volume successfully.
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6698f45c-4cfb-4455-ae24-f95eac813f91]: (4, 'raw') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4c2b8c8e-4f23-45c2-be0e-1310f7c917b6 tempest-SnapshotDependencyTests-70948626 None] Lock "cinder-e8389868-0db7-4411-be65-597e2815f10f-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:16 devstack sudo[106530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD
Sep 04 16:07:16 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:17 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:17 devstack sudo[106534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD
Sep 04 16:07:17 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:17 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD" returned: 1 in 0.360s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 16:07:17 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Temporary image afc4e125-f75e-45fc-b66e-3d0061cf1b90 is fetched for user 630362273e8d4ee5a239db88a8ddcded. {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 04 16:07:17 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f83e06e-15eb-42e0-a804-6f2517bf4ea5]: (4, 'raw') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:17 devstack sudo[106539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD
Sep 04 16:07:17 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:17 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:17 devstack sudo[106543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD
Sep 04 16:07:17 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:18 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD" returned: 1 in 0.373s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 16:07:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:18 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1380d126-8311-4a88-bc10-f105107ac9c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d843498e4eca417f9535674922664cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:16Z,use_quota=True,user_id='630362273e8d4ee5a239db88a8ddcded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd819bee-288b-41b2-aa01-0df33d254fad),volume_type_id=bd819bee-288b-41b2-aa01-0df33d254fad)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:07:18 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Creating volume 1380d126-8311-4a88-bc10-f105107ac9c2 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:07:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:18 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:18 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:18 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:07:18 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:07:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1380d126-8311-4a88-bc10-f105107ac9c2 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:18 devstack sudo[106549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1380d126-8311-4a88-bc10-f105107ac9c2 1073741824
Sep 04 16:07:18 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:18 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1380d126-8311-4a88-bc10-f105107ac9c2 1073741824" returned: 0 in 0.469s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1380d126-8311-4a88-bc10-f105107ac9c2 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:18 devstack sudo[106554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1380d126-8311-4a88-bc10-f105107ac9c2
Sep 04 16:07:18 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:19 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1380d126-8311-4a88-bc10-f105107ac9c2" returned: 0 in 0.260s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:19 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:07:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:19 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Attempting download of afc4e125-f75e-45fc-b66e-3d0061cf1b90 ((None, [{'url': 'file:///opt/stack/data/glance/images/afc4e125-f75e-45fc-b66e-3d0061cf1b90', 'metadata': {}}])) to volume 1380d126-8311-4a88-bc10-f105107ac9c2. {{(pid=87504) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 04 16:07:19 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[98eb56de-2751-4d67-901b-74a7796fc7bc]: (4, 'raw') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_afc4e125-f75e-45fc-b66e-3d0061cf1b90_w8bj4r72 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:19 devstack sudo[106557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_afc4e125-f75e-45fc-b66e-3d0061cf1b90_w8bj4r72
Sep 04 16:07:19 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:19 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_afc4e125-f75e-45fc-b66e-3d0061cf1b90_w8bj4r72" returned: 0 in 0.348s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_afc4e125-f75e-45fc-b66e-3d0061cf1b90_w8bj4r72 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:19 devstack sudo[106562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_afc4e125-f75e-45fc-b66e-3d0061cf1b90_w8bj4r72
Sep 04 16:07:19 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:19 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_afc4e125-f75e-45fc-b66e-3d0061cf1b90_w8bj4r72" returned: 1 in 0.332s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_afc4e125-f75e-45fc-b66e-3d0061cf1b90_w8bj4r72' failed. Not Retrying. {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 16:07:19 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f278f908-53b8-4393-a7b5-5f488ef45536]: (4, 'raw') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:19 devstack sudo[106566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD
Sep 04 16:07:19 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:20 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD" returned: 0 in 0.322s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:20 devstack sudo[106576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD
Sep 04 16:07:20 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:20 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD" returned: 1 in 0.381s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 16:07:20 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] afc4e125-f75e-45fc-b66e-3d0061cf1b90 was raw, converting to qcow2 {{(pid=87504) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 04 16:07:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1380d126-8311-4a88-bc10-f105107ac9c2 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:20 devstack sudo[106581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1380d126-8311-4a88-bc10-f105107ac9c2
Sep 04 16:07:20 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:20 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1380d126-8311-4a88-bc10-f105107ac9c2" returned: 0 in 0.492s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:20 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_afc4e125-f75e-45fc-b66e-3d0061cf1b90__nscf4q3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1380d126-8311-4a88-bc10-f105107ac9c2 {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 16:07:20 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Converted 0.00 MB image at 0.00 MB/s
Sep 04 16:07:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1380d126-8311-4a88-bc10-f105107ac9c2 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:21 devstack sudo[106588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1380d126-8311-4a88-bc10-f105107ac9c2 1G
Sep 04 16:07:21 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:21 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1380d126-8311-4a88-bc10-f105107ac9c2 1G" returned: 0 in 0.369s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:21 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Downloaded image afc4e125-f75e-45fc-b66e-3d0061cf1b90 ((None, [{'url': 'file:///opt/stack/data/glance/images/afc4e125-f75e-45fc-b66e-3d0061cf1b90', 'metadata': {}}])) to volume 1380d126-8311-4a88-bc10-f105107ac9c2 successfully. {{(pid=87504) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 04 16:07:21 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Temporary image afc4e125-f75e-45fc-b66e-3d0061cf1b90 for user 630362273e8d4ee5a239db88a8ddcded is deleted. {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 04 16:07:21 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Marking volume 1380d126-8311-4a88-bc10-f105107ac9c2 as bootable. {{(pid=87504) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 04 16:07:21 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Copying metadata from image afc4e125-f75e-45fc-b66e-3d0061cf1b90 to 1380d126-8311-4a88-bc10-f105107ac9c2. {{(pid=87504) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 04 16:07:21 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Creating volume glance metadata for volume 1380d126-8311-4a88-bc10-f105107ac9c2 backed by image afc4e125-f75e-45fc-b66e-3d0061cf1b90 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'afc4e125-f75e-45fc-b66e-3d0061cf1b90', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '85fd4c4a792e67411ba0833a6f5d7f10', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87504) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 04 16:07:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ecc6fca-2bfd-4623-bc1b-b07f7799acb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1380d126-8311-4a88-bc10-f105107ac9c2', 'volume_size': 1, 'image_id': 'afc4e125-f75e-45fc-b66e-3d0061cf1b90', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/afc4e125-f75e-45fc-b66e-3d0061cf1b90', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '85fd4c4a792e67411ba0833a6f5d7f10', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd843498e4eca417f9535674922664cfc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '96dcde062d5e2470f9ed2d8cf6976913ee362e18e07a446594880c17bebdc559fdc8b4515c61dea203755a8b6bd63c8d907046ea7ee3d3b3f417f2cc33eef128', 'id': 'afc4e125-f75e-45fc-b66e-3d0061cf1b90', 'created_at': datetime.datetime(2026, 9, 4, 14, 7, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 7, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afc4e125-f75e-45fc-b66e-3d0061cf1b90/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1ad18d160>}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ee7fa2-4880-4746-a1e7-e3b5295b61e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:21 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Volume volume-1380d126-8311-4a88-bc10-f105107ac9c2 (1380d126-8311-4a88-bc10-f105107ac9c2): created successfully
Sep 04 16:07:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ee7fa2-4880-4746-a1e7-e3b5295b61e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Flow 'volume_create_manager' (f5793cf3-ccff-4747-8cf7-a652832b3e97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:21 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-2b0ae1e4-617e-44a1-85fe-8e8ba6b80cae tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Created volume successfully.
Sep 04 16:07:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8802eb79-a5c8-4a41-ac0b-d978e1c25da9 tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Acquiring lock "cinder-1380d126-8311-4a88-bc10-f105107ac9c2-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8802eb79-a5c8-4a41-ac0b-d978e1c25da9 tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Lock "cinder-1380d126-8311-4a88-bc10-f105107ac9c2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8802eb79-a5c8-4a41-ac0b-d978e1c25da9 tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Acquiring lock "cinder-quobyte-1380d126-8311-4a88-bc10-f105107ac9c2" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8802eb79-a5c8-4a41-ac0b-d978e1c25da9 tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Lock "cinder-quobyte-1380d126-8311-4a88-bc10-f105107ac9c2" acquired by "delete_volume" :: waited 0.024s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:22 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb33d64f-5402-496c-b60e-acfc15934cb3]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8802eb79-a5c8-4a41-ac0b-d978e1c25da9 tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1380d126-8311-4a88-bc10-f105107ac9c2 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:22 devstack sudo[106597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1380d126-8311-4a88-bc10-f105107ac9c2
Sep 04 16:07:22 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:22 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8802eb79-a5c8-4a41-ac0b-d978e1c25da9 tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1380d126-8311-4a88-bc10-f105107ac9c2" returned: 0 in 0.397s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8802eb79-a5c8-4a41-ac0b-d978e1c25da9 tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1380d126-8311-4a88-bc10-f105107ac9c2 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:23 devstack sudo[106603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1380d126-8311-4a88-bc10-f105107ac9c2
Sep 04 16:07:23 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:23 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8802eb79-a5c8-4a41-ac0b-d978e1c25da9 tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-1380d126-8311-4a88-bc10-f105107ac9c2" returned: 0 in 0.266s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8802eb79-a5c8-4a41-ac0b-d978e1c25da9 tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Lock "cinder-quobyte-1380d126-8311-4a88-bc10-f105107ac9c2" released by "delete_volume" :: held 0.704s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:23 devstack cinder-volume[87504]: WARNING cinder.quota [None req-8802eb79-a5c8-4a41-ac0b-d978e1c25da9 tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 04 16:07:23 devstack cinder-volume[87504]: WARNING cinder.quota [None req-8802eb79-a5c8-4a41-ac0b-d978e1c25da9 tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 04 16:07:23 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-8802eb79-a5c8-4a41-ac0b-d978e1c25da9 tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Created reservations ['06a13ab7-ce2f-4114-88ba-d5d1d0b65c1f', '720a44e6-068d-43a7-afeb-744575b5ff16', 'f07af4ad-4ec9-462a-8691-980bdcdf2627', '8dd2d959-df86-4796-8d6f-44b89e277e51'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:07:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-8802eb79-a5c8-4a41-ac0b-d978e1c25da9 tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-8802eb79-a5c8-4a41-ac0b-d978e1c25da9 tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-8802eb79-a5c8-4a41-ac0b-d978e1c25da9 tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-8802eb79-a5c8-4a41-ac0b-d978e1c25da9 tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-8802eb79-a5c8-4a41-ac0b-d978e1c25da9 tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8802eb79-a5c8-4a41-ac0b-d978e1c25da9 tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:23 devstack sudo[106606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:07:23 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:23 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8802eb79-a5c8-4a41-ac0b-d978e1c25da9 tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.267s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:23 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-8802eb79-a5c8-4a41-ac0b-d978e1c25da9 tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:07:23 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-8802eb79-a5c8-4a41-ac0b-d978e1c25da9 tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Deleted volume successfully.
Sep 04 16:07:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8802eb79-a5c8-4a41-ac0b-d978e1c25da9 tempest-VolumeAndVolumeTypeFromImageTest-347407878 None] Lock "cinder-1380d126-8311-4a88-bc10-f105107ac9c2-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:33 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=49,cinder:UPDATE=50,cinder:INSERT=20,cinder:DELETE=6 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:07:33 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=55,cinder:UPDATE=58,cinder:INSERT=15,cinder:DELETE=3 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Flow 'volume_create_manager' (da4fca44-166f-4149-877d-2fb33e65e0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9714e0c-fc25-4645-b008-c8d78738b401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9714e0c-fc25-4645-b008-c8d78738b401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1193637211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b25f520-faac-4d25-a17c-f0135a6de8e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f661b23fe9c04649a35e39b3309e63cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:38Z,use_quota=True,user_id='8d35e1c5a05d43a1b036e1a4ce542a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7568037b-ce26-4218-a03e-cd7dbc65c04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7568037b-ce26-4218-a03e-cd7dbc65c04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958c4f2d-8dcd-4298-a51e-b484bd421668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958c4f2d-8dcd-4298-a51e-b484bd421668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b25f520-faac-4d25-a17c-f0135a6de8e6', 'volume_name': 'volume-0b25f520-faac-4d25-a17c-f0135a6de8e6', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e50e0a7a-104d-4fe6-94a0-f47330602843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e50e0a7a-104d-4fe6-94a0-f47330602843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19f62fb-c7f0-435c-beff-186a57f406ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:38 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Volume 0b25f520-faac-4d25-a17c-f0135a6de8e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b25f520-faac-4d25-a17c-f0135a6de8e6', 'volume_size': 1}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1193637211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b25f520-faac-4d25-a17c-f0135a6de8e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f661b23fe9c04649a35e39b3309e63cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:38Z,use_quota=True,user_id='8d35e1c5a05d43a1b036e1a4ce542a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Creating volume 0b25f520-faac-4d25-a17c-f0135a6de8e6 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:07:38 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0b25f520-faac-4d25-a17c-f0135a6de8e6 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:38 devstack sudo[106648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0b25f520-faac-4d25-a17c-f0135a6de8e6 1073741824
Sep 04 16:07:38 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Flow 'volume_create_manager' (d82606a0-9086-4ee0-ba91-3f290d709352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c1eaacc-4c8c-4dd5-a672-9f44e8cb055c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c1eaacc-4c8c-4dd5-a672-9f44e8cb055c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-401485604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4daa2e0-3666-4e26-bef5-e06c18add1cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa40ea5dc2c34204ada014671ca124de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:39Z,use_quota=True,user_id='397cd15525d041fbbdb0cc05e2181f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68a8ca0-64b4-4f45-8b17-ab7a2c387f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68a8ca0-64b4-4f45-8b17-ab7a2c387f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3377cae-02bd-41af-83a1-79ae96883d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3377cae-02bd-41af-83a1-79ae96883d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4daa2e0-3666-4e26-bef5-e06c18add1cb', 'volume_name': 'volume-b4daa2e0-3666-4e26-bef5-e06c18add1cb', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9508ff-84c9-4e41-bd5c-e9eb709bc98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9508ff-84c9-4e41-bd5c-e9eb709bc98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e42f8f5-4182-48a3-8897-a3c5f198d164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:39 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Volume b4daa2e0-3666-4e26-bef5-e06c18add1cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4daa2e0-3666-4e26-bef5-e06c18add1cb', 'volume_size': 1}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:39 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0b25f520-faac-4d25-a17c-f0135a6de8e6 1073741824" returned: 0 in 0.652s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0b25f520-faac-4d25-a17c-f0135a6de8e6 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:39 devstack sudo[106654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0b25f520-faac-4d25-a17c-f0135a6de8e6
Sep 04 16:07:39 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Flow 'volume_create_manager' (cd9480eb-b0d7-4e63-ba76-75c7974ac8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53cb9a8c-36f9-4cf2-bd61-8ad47f9da7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53cb9a8c-36f9-4cf2-bd61-8ad47f9da7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-38568803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79eae3b4-4e13-457b-b6b7-354023a6f5ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa40ea5dc2c34204ada014671ca124de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:39Z,use_quota=True,user_id='397cd15525d041fbbdb0cc05e2181f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3113a4bf-875a-4e13-a38e-bb07e86e1400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3113a4bf-875a-4e13-a38e-bb07e86e1400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (583f8b1c-287d-4ab4-b8de-ac3887287e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (583f8b1c-287d-4ab4-b8de-ac3887287e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79eae3b4-4e13-457b-b6b7-354023a6f5ee', 'volume_name': 'volume-79eae3b4-4e13-457b-b6b7-354023a6f5ee', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28ffa09-094a-4ac9-8087-b9ba712edc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28ffa09-094a-4ac9-8087-b9ba712edc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ceb3eb8-0ea4-415a-9dc2-f03eca43fa81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:39 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Volume 79eae3b4-4e13-457b-b6b7-354023a6f5ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79eae3b4-4e13-457b-b6b7-354023a6f5ee', 'volume_size': 1}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:39 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0b25f520-faac-4d25-a17c-f0135a6de8e6" returned: 0 in 0.345s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.719s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-401485604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4daa2e0-3666-4e26-bef5-e06c18add1cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa40ea5dc2c34204ada014671ca124de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:39Z,use_quota=True,user_id='397cd15525d041fbbdb0cc05e2181f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Creating volume b4daa2e0-3666-4e26-bef5-e06c18add1cb {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:07:39 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b4daa2e0-3666-4e26-bef5-e06c18add1cb 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19f62fb-c7f0-435c-beff-186a57f406ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b25f520-faac-4d25-a17c-f0135a6de8e6', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:39 devstack sudo[106657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b4daa2e0-3666-4e26-bef5-e06c18add1cb 1073741824
Sep 04 16:07:39 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c069b367-d627-49ed-bc68-690a81346e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:39 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Volume volume-0b25f520-faac-4d25-a17c-f0135a6de8e6 (0b25f520-faac-4d25-a17c-f0135a6de8e6): created successfully
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c069b367-d627-49ed-bc68-690a81346e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Flow 'volume_create_manager' (da4fca44-166f-4149-877d-2fb33e65e0b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:39 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-c58fba70-9c44-402b-baef-3c1226903634 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Created volume successfully.
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Flow 'volume_create_manager' (5373f023-5b4f-4916-bed2-2841f5d11127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b3b1db-3bd8-4de3-994e-9de093dd7b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b3b1db-3bd8-4de3-994e-9de093dd7b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2089323597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20f9a789-6099-4325-93e6-44956de7a04c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa40ea5dc2c34204ada014671ca124de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:40Z,use_quota=True,user_id='397cd15525d041fbbdb0cc05e2181f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c0c4be-ab77-4020-bc84-4236d6e7439a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c0c4be-ab77-4020-bc84-4236d6e7439a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df9f0cb2-7681-4854-a464-97142e11791f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df9f0cb2-7681-4854-a464-97142e11791f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20f9a789-6099-4325-93e6-44956de7a04c', 'volume_name': 'volume-20f9a789-6099-4325-93e6-44956de7a04c', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e569ec-06e5-45b0-a43d-2fe67d71e2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e569ec-06e5-45b0-a43d-2fe67d71e2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eda1745-b07a-44da-9b10-4f5864cd91c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:40 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Volume 20f9a789-6099-4325-93e6-44956de7a04c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20f9a789-6099-4325-93e6-44956de7a04c', 'volume_size': 1}
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:40 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b4daa2e0-3666-4e26-bef5-e06c18add1cb 1073741824" returned: 0 in 0.722s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b4daa2e0-3666-4e26-bef5-e06c18add1cb {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:40 devstack sudo[106662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b4daa2e0-3666-4e26-bef5-e06c18add1cb
Sep 04 16:07:40 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Flow 'volume_create_manager' (766516dd-9f52-4084-84dd-3cc141b79656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c16f11-77f5-4a3b-bffd-a1f492808eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c16f11-77f5-4a3b-bffd-a1f492808eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-410431775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d9ce77-3e0f-449d-a360-0afc38232651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa40ea5dc2c34204ada014671ca124de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:41Z,use_quota=True,user_id='397cd15525d041fbbdb0cc05e2181f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4425ec2c-47f6-4505-b16f-cb63713b5fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4425ec2c-47f6-4505-b16f-cb63713b5fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0283bd32-75cc-4f91-adb0-307b2f5c46a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0283bd32-75cc-4f91-adb0-307b2f5c46a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39d9ce77-3e0f-449d-a360-0afc38232651', 'volume_name': 'volume-39d9ce77-3e0f-449d-a360-0afc38232651', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1614bf-28de-4fbb-8998-56394c04aa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1614bf-28de-4fbb-8998-56394c04aa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500ede81-ba30-4a79-9052-aac4a4e7c1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:40 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Volume 39d9ce77-3e0f-449d-a360-0afc38232651: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39d9ce77-3e0f-449d-a360-0afc38232651', 'volume_size': 1}
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:40 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b4daa2e0-3666-4e26-bef5-e06c18add1cb" returned: 0 in 0.448s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:07:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.347s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-38568803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79eae3b4-4e13-457b-b6b7-354023a6f5ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa40ea5dc2c34204ada014671ca124de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:39Z,use_quota=True,user_id='397cd15525d041fbbdb0cc05e2181f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Creating volume 79eae3b4-4e13-457b-b6b7-354023a6f5ee {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:07:41 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-79eae3b4-4e13-457b-b6b7-354023a6f5ee 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e42f8f5-4182-48a3-8897-a3c5f198d164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4daa2e0-3666-4e26-bef5-e06c18add1cb', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:41 devstack sudo[106665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-79eae3b4-4e13-457b-b6b7-354023a6f5ee 1073741824
Sep 04 16:07:41 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7317a0-54f6-4881-8c0a-f1d9d5082752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:41 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Volume volume-b4daa2e0-3666-4e26-bef5-e06c18add1cb (b4daa2e0-3666-4e26-bef5-e06c18add1cb): created successfully
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7317a0-54f6-4881-8c0a-f1d9d5082752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Flow 'volume_create_manager' (d82606a0-9086-4ee0-ba91-3f290d709352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:41 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-216c3eea-a137-41a4-9fd9-fca0efaf769d tempest-CreateVolumesFromImageTest-1861563137 None] Created volume successfully.
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:07:41 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Flow 'volume_create_manager' (a049c707-5f11-44de-a9c7-897bd05ced97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62038bf6-16cb-45cb-b2c2-c5ce98236d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-79eae3b4-4e13-457b-b6b7-354023a6f5ee 1073741824" returned: 0 in 0.807s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62038bf6-16cb-45cb-b2c2-c5ce98236d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-344769018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d88090-21e1-4b9a-b319-2f02da7a3bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f661b23fe9c04649a35e39b3309e63cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:42Z,use_quota=True,user_id='8d35e1c5a05d43a1b036e1a4ce542a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177a7e38-50e8-4767-8b06-9be5b4745a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177a7e38-50e8-4767-8b06-9be5b4745a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbcf0e67-97cc-49be-b6e2-bf0339a75868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbcf0e67-97cc-49be-b6e2-bf0339a75868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90d88090-21e1-4b9a-b319-2f02da7a3bb7', 'volume_name': 'volume-90d88090-21e1-4b9a-b319-2f02da7a3bb7', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3348c6-add2-4103-aee9-4fef2786f220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3348c6-add2-4103-aee9-4fef2786f220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a13a9c0d-1cd5-4b71-9d53-1aef70214654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:41 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Volume 90d88090-21e1-4b9a-b319-2f02da7a3bb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90d88090-21e1-4b9a-b319-2f02da7a3bb7', 'volume_size': 1}
Sep 04 16:07:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-79eae3b4-4e13-457b-b6b7-354023a6f5ee {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:07:42 devstack sudo[106672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-79eae3b4-4e13-457b-b6b7-354023a6f5ee
Sep 04 16:07:42 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Flow 'volume_create_manager' (4436bac3-4d1a-40e8-9ad7-a42b92b227e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (086811f1-5e9e-4d45-bcf1-90fb70d5a5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (086811f1-5e9e-4d45-bcf1-90fb70d5a5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2030202486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa40ea5dc2c34204ada014671ca124de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:42Z,use_quota=True,user_id='397cd15525d041fbbdb0cc05e2181f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e895e6-48ba-4bd8-a5a6-fb39df8902f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e895e6-48ba-4bd8-a5a6-fb39df8902f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c38562f-42fd-4d5d-a820-6932885fee6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c38562f-42fd-4d5d-a820-6932885fee6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23', 'volume_name': 'volume-af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d2b68b-9a6d-400f-b6dc-c858a5f1cc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d2b68b-9a6d-400f-b6dc-c858a5f1cc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf9d040-cd8a-4377-987e-86e57b7e79a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:42 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Volume af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23', 'volume_size': 1}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Flow 'volume_create_manager' (4a6a4c3c-0389-42d4-9b3e-97440d9830f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc03f26-57a4-4ea9-8c20-2554f50ef7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc03f26-57a4-4ea9-8c20-2554f50ef7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-372860994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb2d3af-c468-4845-b293-06418e90d86f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f661b23fe9c04649a35e39b3309e63cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:42Z,use_quota=True,user_id='8d35e1c5a05d43a1b036e1a4ce542a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (838e0ff1-8f30-4ebe-ab73-68cee8e11472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (838e0ff1-8f30-4ebe-ab73-68cee8e11472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403083d4-b768-4551-b449-484392ea918d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403083d4-b768-4551-b449-484392ea918d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beb2d3af-c468-4845-b293-06418e90d86f', 'volume_name': 'volume-beb2d3af-c468-4845-b293-06418e90d86f', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ac8a51-370a-457a-ab18-c5e8c6e37899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ac8a51-370a-457a-ab18-c5e8c6e37899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea93e0e-ac9e-4646-b32a-786c732a3435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:42 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Volume beb2d3af-c468-4845-b293-06418e90d86f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beb2d3af-c468-4845-b293-06418e90d86f', 'volume_size': 1}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:42 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-79eae3b4-4e13-457b-b6b7-354023a6f5ee" returned: 0 in 0.370s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.119s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2089323597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20f9a789-6099-4325-93e6-44956de7a04c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa40ea5dc2c34204ada014671ca124de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:40Z,use_quota=True,user_id='397cd15525d041fbbdb0cc05e2181f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Creating volume 20f9a789-6099-4325-93e6-44956de7a04c {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:07:42 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-20f9a789-6099-4325-93e6-44956de7a04c 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ceb3eb8-0ea4-415a-9dc2-f03eca43fa81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79eae3b4-4e13-457b-b6b7-354023a6f5ee', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:42 devstack sudo[106675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-20f9a789-6099-4325-93e6-44956de7a04c 1073741824
Sep 04 16:07:42 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62648ac-3dde-4182-81b8-199cc7890de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:42 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Volume volume-79eae3b4-4e13-457b-b6b7-354023a6f5ee (79eae3b4-4e13-457b-b6b7-354023a6f5ee): created successfully
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62648ac-3dde-4182-81b8-199cc7890de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Flow 'volume_create_manager' (cd9480eb-b0d7-4e63-ba76-75c7974ac8e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:42 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e510f69a-803d-42dd-a031-cf6a9876e768 tempest-CreateVolumesFromImageTest-1861563137 None] Created volume successfully.
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Flow 'volume_create_manager' (ecc64a8b-2ef6-43bc-a1fa-70fe1b50d682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00e24f1-c4e0-41e7-b392-c63cc7576181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00e24f1-c4e0-41e7-b392-c63cc7576181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1953617690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2187e4fd-1622-46d4-8d75-3bb136927c9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f661b23fe9c04649a35e39b3309e63cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:43Z,use_quota=True,user_id='8d35e1c5a05d43a1b036e1a4ce542a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (017c7d8e-884c-4042-864e-4aad5062ebe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (017c7d8e-884c-4042-864e-4aad5062ebe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff83d933-586c-4e5b-93a3-842c473c83bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff83d933-586c-4e5b-93a3-842c473c83bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2187e4fd-1622-46d4-8d75-3bb136927c9c', 'volume_name': 'volume-2187e4fd-1622-46d4-8d75-3bb136927c9c', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a02338b5-32e9-4355-943d-1c99b51f1e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a02338b5-32e9-4355-943d-1c99b51f1e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a48116-f466-466d-8ec9-aae91ef3fa22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:42 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Volume 2187e4fd-1622-46d4-8d75-3bb136927c9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2187e4fd-1622-46d4-8d75-3bb136927c9c', 'volume_size': 1}
Sep 04 16:07:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:43 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-20f9a789-6099-4325-93e6-44956de7a04c 1073741824" returned: 0 in 0.804s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-20f9a789-6099-4325-93e6-44956de7a04c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:43 devstack sudo[106685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-20f9a789-6099-4325-93e6-44956de7a04c
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:07:43 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Flow 'volume_create_manager' (b45f7243-18fb-447c-93a8-d79124ce04a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505b93f9-1d2a-4773-a061-c5aff087032e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505b93f9-1d2a-4773-a061-c5aff087032e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abfa0278-b08d-4c73-9a2b-489656a7a89a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='739c9c921a474ae2a31628b048f0c8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:43Z,use_quota=True,user_id='1d0d4946a0004fbe80808657860da441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889619e6-f93d-4c6f-98b8-f218881d0aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889619e6-f93d-4c6f-98b8-f218881d0aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9455e1ab-06ba-443e-9851-3bc504471cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.image.glance [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Creating Keystone auth plugin from conf {{(pid=87504) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Flow 'volume_create_manager' (f12f2c51-6752-4553-838e-620b74317bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c861ad1-1f63-499b-bebb-3d5ff623ec09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c861ad1-1f63-499b-bebb-3d5ff623ec09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1108157816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e551ffdc-e27b-4354-a3e6-d4f35eb3e78d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f661b23fe9c04649a35e39b3309e63cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:43Z,use_quota=True,user_id='8d35e1c5a05d43a1b036e1a4ce542a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc96c380-66c9-4856-a407-9a6871cbd903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc96c380-66c9-4856-a407-9a6871cbd903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a5e9f00-83ad-4b2f-ae9f-7936d9b8d125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a5e9f00-83ad-4b2f-ae9f-7936d9b8d125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e551ffdc-e27b-4354-a3e6-d4f35eb3e78d', 'volume_name': 'volume-e551ffdc-e27b-4354-a3e6-d4f35eb3e78d', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f9bf71-c91c-44ea-b8db-ee48dec1e49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f9bf71-c91c-44ea-b8db-ee48dec1e49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1446ad-ba5d-4860-a86e-e941596f22b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:43 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Volume e551ffdc-e27b-4354-a3e6-d4f35eb3e78d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e551ffdc-e27b-4354-a3e6-d4f35eb3e78d', 'volume_size': 1}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:43 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-20f9a789-6099-4325-93e6-44956de7a04c" returned: 0 in 0.446s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.861s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-410431775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d9ce77-3e0f-449d-a360-0afc38232651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa40ea5dc2c34204ada014671ca124de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:41Z,use_quota=True,user_id='397cd15525d041fbbdb0cc05e2181f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Creating volume 39d9ce77-3e0f-449d-a360-0afc38232651 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:07:43 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-39d9ce77-3e0f-449d-a360-0afc38232651 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:43 devstack sudo[106688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-39d9ce77-3e0f-449d-a360-0afc38232651 1073741824
Sep 04 16:07:43 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eda1745-b07a-44da-9b10-4f5864cd91c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20f9a789-6099-4325-93e6-44956de7a04c', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94cd3204-9d18-46e8-a432-ea495628b48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:43 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Volume volume-20f9a789-6099-4325-93e6-44956de7a04c (20f9a789-6099-4325-93e6-44956de7a04c): created successfully
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94cd3204-9d18-46e8-a432-ea495628b48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Flow 'volume_create_manager' (5373f023-5b4f-4916-bed2-2841f5d11127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9455e1ab-06ba-443e-9851-3bc504471cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'abfa0278-b08d-4c73-9a2b-489656a7a89a', 'volume_name': 'volume-abfa0278-b08d-4c73-9a2b-489656a7a89a', 'volume_size': 1, 'image_id': '92e3f49f-28ed-41c4-8374-1b3ef5194e28', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92e3f49f-28ed-41c4-8374-1b3ef5194e28', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5fbc13cbe8dbfe6ca5be4d16ff05f5ed', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '739c9c921a474ae2a31628b048f0c8c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '26f21a6991cc996271fc037daeb299edd1f560059773c6fc746b6f78eb31a3c2fa8f0c48d92900f934f6c03df03652d9f0c66da1136873759831614967170da8', 'id': '92e3f49f-28ed-41c4-8374-1b3ef5194e28', 'created_at': datetime.datetime(2026, 9, 4, 14, 7, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 7, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92e3f49f-28ed-41c4-8374-1b3ef5194e28/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1ad773470>}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1707300d-0c97-4aa6-bcda-459423583df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1707300d-0c97-4aa6-bcda-459423583df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401fd56c-b8a9-4fa8-ac83-7e087cbeefd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:43 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Volume abfa0278-b08d-4c73-9a2b-489656a7a89a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-abfa0278-b08d-4c73-9a2b-489656a7a89a', 'volume_size': 1, 'image_id': '92e3f49f-28ed-41c4-8374-1b3ef5194e28', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92e3f49f-28ed-41c4-8374-1b3ef5194e28', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5fbc13cbe8dbfe6ca5be4d16ff05f5ed', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '739c9c921a474ae2a31628b048f0c8c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '26f21a6991cc996271fc037daeb299edd1f560059773c6fc746b6f78eb31a3c2fa8f0c48d92900f934f6c03df03652d9f0c66da1136873759831614967170da8', 'id': '92e3f49f-28ed-41c4-8374-1b3ef5194e28', 'created_at': datetime.datetime(2026, 9, 4, 14, 7, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 7, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92e3f49f-28ed-41c4-8374-1b3ef5194e28/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1ad773470>}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Trying to clone abfa0278-b08d-4c73-9a2b-489656a7a89a from image 92e3f49f-28ed-41c4-8374-1b3ef5194e28 at location (None, [{'url': 'file:///opt/stack/data/glance/images/92e3f49f-28ed-41c4-8374-1b3ef5194e28', 'metadata': {}}]). {{(pid=87504) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 04 16:07:43 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-3b6d495a-9a99-4106-ada8-89db8206ce07 tempest-CreateVolumesFromImageTest-1861563137 None] Created volume successfully.
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Flow 'volume_create_manager' (d861a395-f4c5-4e9c-8f7b-5fa1d5f80a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4bd1d4e-5e5f-4475-9d0d-e665e5a377b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4bd1d4e-5e5f-4475-9d0d-e665e5a377b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-15964478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdababc9-6961-4cad-b22b-fb871d1f2799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f661b23fe9c04649a35e39b3309e63cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:44Z,use_quota=True,user_id='8d35e1c5a05d43a1b036e1a4ce542a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e4a2c7-5626-4af7-894c-6e655dab100d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e4a2c7-5626-4af7-894c-6e655dab100d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18c3a4c-f1f0-40ae-b502-751c776d5796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18c3a4c-f1f0-40ae-b502-751c776d5796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdababc9-6961-4cad-b22b-fb871d1f2799', 'volume_name': 'volume-cdababc9-6961-4cad-b22b-fb871d1f2799', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790b08c9-c4f4-4ded-a6de-6bf4f59927fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790b08c9-c4f4-4ded-a6de-6bf4f59927fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e15506a-4bda-46db-8b18-d6d7beaf665f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:44 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Volume cdababc9-6961-4cad-b22b-fb871d1f2799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdababc9-6961-4cad-b22b-fb871d1f2799', 'volume_size': 1}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 04 16:07:44 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Image download 0.00 MB at 0.00 MB/s
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dc81fb-5789-4f2f-b077-aba7eaa7d08f]: (4, 'raw') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:44 devstack sudo[106693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD
Sep 04 16:07:44 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:44 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-39d9ce77-3e0f-449d-a360-0afc38232651 1073741824" returned: 0 in 0.647s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-39d9ce77-3e0f-449d-a360-0afc38232651 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:44 devstack sudo[106696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-39d9ce77-3e0f-449d-a360-0afc38232651
Sep 04 16:07:44 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Flow 'volume_create_manager' (284f8006-3a1a-4ac1-9337-3670a36f270e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:44 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58771ed-d187-49bc-a7e6-48dfba468e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58771ed-d187-49bc-a7e6-48dfba468e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd3ed11-05e6-4165-a2b3-2e0a87e00e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ea54ef661c744539a85398472a475dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:44Z,use_quota=True,user_id='2d82ca988df14268a3f44c8c4674b492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39113aae-dab5-4fbc-9aa7-a3e4a030e8e1),volume_type_id=39113aae-dab5-4fbc-9aa7-a3e4a030e8e1)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35aea040-ef95-453b-b2d0-012dda3affab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35aea040-ef95-453b-b2d0-012dda3affab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e459929-3e74-48c9-a395-91ff32c259a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.image.glance [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Creating Keystone auth plugin from conf {{(pid=87504) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 04 16:07:44 devstack sudo[106700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD
Sep 04 16:07:44 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:44 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-39d9ce77-3e0f-449d-a360-0afc38232651" returned: 0 in 0.274s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.793s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-344769018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d88090-21e1-4b9a-b319-2f02da7a3bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f661b23fe9c04649a35e39b3309e63cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:42Z,use_quota=True,user_id='8d35e1c5a05d43a1b036e1a4ce542a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Creating volume 90d88090-21e1-4b9a-b319-2f02da7a3bb7 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:07:44 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-90d88090-21e1-4b9a-b319-2f02da7a3bb7 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:44 devstack sudo[106704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-90d88090-21e1-4b9a-b319-2f02da7a3bb7 1073741824
Sep 04 16:07:44 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500ede81-ba30-4a79-9052-aac4a4e7c1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39d9ce77-3e0f-449d-a360-0afc38232651', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e41a3296-521a-49b8-a323-fd217b82e97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:44 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Volume volume-39d9ce77-3e0f-449d-a360-0afc38232651 (39d9ce77-3e0f-449d-a360-0afc38232651): created successfully
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e41a3296-521a-49b8-a323-fd217b82e97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Flow 'volume_create_manager' (766516dd-9f52-4084-84dd-3cc141b79656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e459929-3e74-48c9-a395-91ff32c259a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dfd3ed11-05e6-4165-a2b3-2e0a87e00e56', 'volume_name': 'volume-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56', 'volume_size': 1, 'image_id': '04bb8204-b734-4c31-ae1b-fc7dde1c7c99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04bb8204-b734-4c31-ae1b-fc7dde1c7c99', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '18fbfc36a3a7f22dc07b864634397142', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0ea54ef661c744539a85398472a475dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '11729f8ac2ff1703b4083c95adbef3c4976fadcac904aa25fddf053202aa9037e50321e678e2a778706c794465db63f9937e6d17e584148e8d3267f49c86f7b3', 'id': '04bb8204-b734-4c31-ae1b-fc7dde1c7c99', 'created_at': datetime.datetime(2026, 9, 4, 14, 7, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 7, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04bb8204-b734-4c31-ae1b-fc7dde1c7c99/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1ad0b0ec0>}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea76959-37a3-4a13-a010-eb9248606fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea76959-37a3-4a13-a010-eb9248606fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa376f7-8ec7-4f4a-88e3-b8db131c7e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:44 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Volume dfd3ed11-05e6-4165-a2b3-2e0a87e00e56: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56', 'volume_size': 1, 'image_id': '04bb8204-b734-4c31-ae1b-fc7dde1c7c99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04bb8204-b734-4c31-ae1b-fc7dde1c7c99', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '18fbfc36a3a7f22dc07b864634397142', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0ea54ef661c744539a85398472a475dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '11729f8ac2ff1703b4083c95adbef3c4976fadcac904aa25fddf053202aa9037e50321e678e2a778706c794465db63f9937e6d17e584148e8d3267f49c86f7b3', 'id': '04bb8204-b734-4c31-ae1b-fc7dde1c7c99', 'created_at': datetime.datetime(2026, 9, 4, 14, 7, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 7, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04bb8204-b734-4c31-ae1b-fc7dde1c7c99/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1ad0b0ec0>}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Trying to clone dfd3ed11-05e6-4165-a2b3-2e0a87e00e56 from image 04bb8204-b734-4c31-ae1b-fc7dde1c7c99 at location (None, [{'url': 'file:///opt/stack/data/glance/images/04bb8204-b734-4c31-ae1b-fc7dde1c7c99', 'metadata': {}}]). {{(pid=87504) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 04 16:07:44 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-4dc99ec9-7132-4ccc-b991-24d1ad0fe7e4 tempest-CreateVolumesFromImageTest-1861563137 None] Created volume successfully.
Sep 04 16:07:44 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD" returned: 1 in 0.397s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 16:07:44 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Temporary image 92e3f49f-28ed-41c4-8374-1b3ef5194e28 is fetched for user 1d0d4946a0004fbe80808657860da441. {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 04 16:07:45 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Image download 0.00 MB at 0.00 MB/s
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a084c64-173e-4837-bb99-f10c002bdd22]: (4, 'raw') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e67a73-db38-4c94-9796-a7a06cf5ba80]: (4, 'raw') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:45 devstack sudo[106711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD
Sep 04 16:07:45 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:45 devstack sudo[106713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD
Sep 04 16:07:45 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:45 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-90d88090-21e1-4b9a-b319-2f02da7a3bb7 1073741824" returned: 0 in 0.504s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-90d88090-21e1-4b9a-b319-2f02da7a3bb7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:45 devstack sudo[106717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-90d88090-21e1-4b9a-b319-2f02da7a3bb7
Sep 04 16:07:45 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:45 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:45 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:45 devstack sudo[106723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD
Sep 04 16:07:45 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:45 devstack sudo[106724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD
Sep 04 16:07:45 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:45 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-90d88090-21e1-4b9a-b319-2f02da7a3bb7" returned: 0 in 0.303s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.347s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2030202486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa40ea5dc2c34204ada014671ca124de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:42Z,use_quota=True,user_id='397cd15525d041fbbdb0cc05e2181f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Creating volume af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:07:45 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:45 devstack sudo[106728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23 1073741824
Sep 04 16:07:45 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a13a9c0d-1cd5-4b71-9d53-1aef70214654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90d88090-21e1-4b9a-b319-2f02da7a3bb7', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (783397ca-b17e-4ba7-a3fb-075655c32012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:45 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Volume volume-90d88090-21e1-4b9a-b319-2f02da7a3bb7 (90d88090-21e1-4b9a-b319-2f02da7a3bb7): created successfully
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (783397ca-b17e-4ba7-a3fb-075655c32012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Flow 'volume_create_manager' (a049c707-5f11-44de-a9c7-897bd05ced97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:45 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-612c61c2-f98e-4d88-8494-d8d016a88759 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Created volume successfully.
Sep 04 16:07:45 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD" returned: 1 in 0.392s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:45 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Temporary image 04bb8204-b734-4c31-ae1b-fc7dde1c7c99 is fetched for user 2d82ca988df14268a3f44c8c4674b492. {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8402b1b-586c-459c-9511-5098d4391585]: (4, 'raw') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:46 devstack sudo[106740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD
Sep 04 16:07:46 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:46 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23 1073741824" returned: 0 in 0.604s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:46 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:46 devstack sudo[106746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23
Sep 04 16:07:46 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:46 devstack sudo[106747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD
Sep 04 16:07:46 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:46 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23" returned: 0 in 0.270s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:46 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:07:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.138s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:46 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-372860994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb2d3af-c468-4845-b293-06418e90d86f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f661b23fe9c04649a35e39b3309e63cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:42Z,use_quota=True,user_id='8d35e1c5a05d43a1b036e1a4ce542a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:07:46 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Creating volume beb2d3af-c468-4845-b293-06418e90d86f {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:07:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:46 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:46 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:46 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:07:46 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:07:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-beb2d3af-c468-4845-b293-06418e90d86f 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf9d040-cd8a-4377-987e-86e57b7e79a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:46 devstack sudo[106751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-beb2d3af-c468-4845-b293-06418e90d86f 1073741824
Sep 04 16:07:46 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d423c59a-3205-4961-9def-7fa8324645ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:46 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Volume volume-af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23 (af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23): created successfully
Sep 04 16:07:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d423c59a-3205-4961-9def-7fa8324645ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:46 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Flow 'volume_create_manager' (4436bac3-4d1a-40e8-9ad7-a42b92b227e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:46 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-63a087f6-2453-479f-85f9-f50afee72cf9 tempest-CreateVolumesFromImageTest-1861563137 None] Created volume successfully.
Sep 04 16:07:46 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD" returned: 1 in 0.362s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 16:07:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:46 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-beb2d3af-c468-4845-b293-06418e90d86f 1073741824" returned: 0 in 0.403s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-beb2d3af-c468-4845-b293-06418e90d86f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:47 devstack sudo[106760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-beb2d3af-c468-4845-b293-06418e90d86f
Sep 04 16:07:47 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:47 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-beb2d3af-c468-4845-b293-06418e90d86f" returned: 0 in 0.262s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.551s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1953617690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2187e4fd-1622-46d4-8d75-3bb136927c9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f661b23fe9c04649a35e39b3309e63cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:43Z,use_quota=True,user_id='8d35e1c5a05d43a1b036e1a4ce542a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Creating volume 2187e4fd-1622-46d4-8d75-3bb136927c9c {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:07:47 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2187e4fd-1622-46d4-8d75-3bb136927c9c 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea93e0e-ac9e-4646-b32a-786c732a3435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beb2d3af-c468-4845-b293-06418e90d86f', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:47 devstack sudo[106763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2187e4fd-1622-46d4-8d75-3bb136927c9c 1073741824
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63895df-542e-44c2-b167-b7895e1fc250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:47 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:47 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Volume volume-beb2d3af-c468-4845-b293-06418e90d86f (beb2d3af-c468-4845-b293-06418e90d86f): created successfully
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63895df-542e-44c2-b167-b7895e1fc250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Flow 'volume_create_manager' (4a6a4c3c-0389-42d4-9b3e-97440d9830f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:47 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-bfa4511d-ca9a-4936-a2ed-0bfa29bcbf53 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Created volume successfully.
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a0e49d76-d416-433e-92c3-7b3ab15cf560 tempest-CreateVolumesFromImageTest-1861563137 None] Acquiring lock "cinder-af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a0e49d76-d416-433e-92c3-7b3ab15cf560 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "cinder-af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:47 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2187e4fd-1622-46d4-8d75-3bb136927c9c 1073741824" returned: 0 in 0.506s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a0e49d76-d416-433e-92c3-7b3ab15cf560 tempest-CreateVolumesFromImageTest-1861563137 None] Acquiring lock "cinder-quobyte-af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a0e49d76-d416-433e-92c3-7b3ab15cf560 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "cinder-quobyte-af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23" acquired by "delete_volume" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a36e39-306f-4826-9236-6882cac8baf6]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a0e49d76-d416-433e-92c3-7b3ab15cf560 tempest-CreateVolumesFromImageTest-1861563137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2187e4fd-1622-46d4-8d75-3bb136927c9c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:47 devstack sudo[106770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2187e4fd-1622-46d4-8d75-3bb136927c9c
Sep 04 16:07:47 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:47 devstack sudo[106769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23
Sep 04 16:07:47 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:48 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2187e4fd-1622-46d4-8d75-3bb136927c9c" returned: 0 in 0.255s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.476s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1108157816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e551ffdc-e27b-4354-a3e6-d4f35eb3e78d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f661b23fe9c04649a35e39b3309e63cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:43Z,use_quota=True,user_id='8d35e1c5a05d43a1b036e1a4ce542a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Creating volume e551ffdc-e27b-4354-a3e6-d4f35eb3e78d {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:07:48 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e551ffdc-e27b-4354-a3e6-d4f35eb3e78d 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a48116-f466-466d-8ec9-aae91ef3fa22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2187e4fd-1622-46d4-8d75-3bb136927c9c', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:48 devstack sudo[106774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e551ffdc-e27b-4354-a3e6-d4f35eb3e78d 1073741824
Sep 04 16:07:48 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2c434e0-aa47-4749-8f56-46e1778ce739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:48 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Volume volume-2187e4fd-1622-46d4-8d75-3bb136927c9c (2187e4fd-1622-46d4-8d75-3bb136927c9c): created successfully
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2c434e0-aa47-4749-8f56-46e1778ce739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Flow 'volume_create_manager' (ecc64a8b-2ef6-43bc-a1fa-70fe1b50d682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:48 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-cb9e6e98-ea61-4d0e-bfa3-4a1214c52d34 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Created volume successfully.
Sep 04 16:07:48 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a0e49d76-d416-433e-92c3-7b3ab15cf560 tempest-CreateVolumesFromImageTest-1861563137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23" returned: 0 in 0.415s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a0e49d76-d416-433e-92c3-7b3ab15cf560 tempest-CreateVolumesFromImageTest-1861563137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:48 devstack sudo[106779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23
Sep 04 16:07:48 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:48 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a0e49d76-d416-433e-92c3-7b3ab15cf560 tempest-CreateVolumesFromImageTest-1861563137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23" returned: 0 in 0.293s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a0e49d76-d416-433e-92c3-7b3ab15cf560 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "cinder-quobyte-af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23" released by "delete_volume" :: held 0.751s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:48 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e551ffdc-e27b-4354-a3e6-d4f35eb3e78d 1073741824" returned: 0 in 0.469s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-a0e49d76-d416-433e-92c3-7b3ab15cf560 tempest-CreateVolumesFromImageTest-1861563137 None] Created reservations ['e9bd380d-2c72-40cc-8136-bf98c139776a', '8d0490ab-e94d-4d39-8d81-f54ea2a51be9', '19a50cc7-0ff7-453b-befd-10f12033fbe6', 'c107ff7a-8b2f-4c3b-860d-4f2271e9c450'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e551ffdc-e27b-4354-a3e6-d4f35eb3e78d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:48 devstack sudo[106786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e551ffdc-e27b-4354-a3e6-d4f35eb3e78d
Sep 04 16:07:48 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a0e49d76-d416-433e-92c3-7b3ab15cf560 tempest-CreateVolumesFromImageTest-1861563137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a0e49d76-d416-433e-92c3-7b3ab15cf560 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a0e49d76-d416-433e-92c3-7b3ab15cf560 tempest-CreateVolumesFromImageTest-1861563137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a0e49d76-d416-433e-92c3-7b3ab15cf560 tempest-CreateVolumesFromImageTest-1861563137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a0e49d76-d416-433e-92c3-7b3ab15cf560 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a0e49d76-d416-433e-92c3-7b3ab15cf560 tempest-CreateVolumesFromImageTest-1861563137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:48 devstack sudo[106788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:07:48 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:48 devstack sudo[106790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:07:48 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:48 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b6d6ccfd-be81-480a-abc6-dea6f82a4bf5 tempest-CreateVolumesFromImageTest-1861563137 None] Acquiring lock "cinder-39d9ce77-3e0f-449d-a360-0afc38232651-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b6d6ccfd-be81-480a-abc6-dea6f82a4bf5 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "cinder-39d9ce77-3e0f-449d-a360-0afc38232651-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:49 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e551ffdc-e27b-4354-a3e6-d4f35eb3e78d" returned: 0 in 0.383s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.984s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-15964478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdababc9-6961-4cad-b22b-fb871d1f2799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f661b23fe9c04649a35e39b3309e63cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:44Z,use_quota=True,user_id='8d35e1c5a05d43a1b036e1a4ce542a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Creating volume cdababc9-6961-4cad-b22b-fb871d1f2799 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:07:49 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cdababc9-6961-4cad-b22b-fb871d1f2799 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:49 devstack sudo[106794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cdababc9-6961-4cad-b22b-fb871d1f2799 1073741824
Sep 04 16:07:49 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1446ad-ba5d-4860-a86e-e941596f22b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e551ffdc-e27b-4354-a3e6-d4f35eb3e78d', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4768ca-f7ec-40f0-83a0-0f908ad9eac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:49 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a0e49d76-d416-433e-92c3-7b3ab15cf560 tempest-CreateVolumesFromImageTest-1861563137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.346s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-a0e49d76-d416-433e-92c3-7b3ab15cf560 tempest-CreateVolumesFromImageTest-1861563137 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b6d6ccfd-be81-480a-abc6-dea6f82a4bf5 tempest-CreateVolumesFromImageTest-1861563137 None] Acquiring lock "cinder-quobyte-39d9ce77-3e0f-449d-a360-0afc38232651" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:49 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Volume volume-e551ffdc-e27b-4354-a3e6-d4f35eb3e78d (e551ffdc-e27b-4354-a3e6-d4f35eb3e78d): created successfully
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4768ca-f7ec-40f0-83a0-0f908ad9eac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Flow 'volume_create_manager' (f12f2c51-6752-4553-838e-620b74317bbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:49 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-a0e49d76-d416-433e-92c3-7b3ab15cf560 tempest-CreateVolumesFromImageTest-1861563137 None] Deleted volume successfully.
Sep 04 16:07:49 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-453b4179-bc51-48b5-a745-801b1818cd83 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Created volume successfully.
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b6d6ccfd-be81-480a-abc6-dea6f82a4bf5 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "cinder-quobyte-39d9ce77-3e0f-449d-a360-0afc38232651" acquired by "delete_volume" :: waited 0.044s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a0e49d76-d416-433e-92c3-7b3ab15cf560 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "cinder-af4b52ce-137f-4a9e-a2cb-9a1ce98f5c23-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49848c5-9e2d-43ff-b869-8825419b43f4]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b6d6ccfd-be81-480a-abc6-dea6f82a4bf5 tempest-CreateVolumesFromImageTest-1861563137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-39d9ce77-3e0f-449d-a360-0afc38232651 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:49 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.361s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager._thread_info {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread count: 28 {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread info: [<_MainThread(MainThread, started 131673838448768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131673724603200)>, <Thread(Thread-3 (stat_writer), started daemon 131673723495936)>, <Thread(Rabbit-heartbeat, started daemon 131673723764800)>, <Thread(Thread-5 (_runner), started daemon 131673722269632)>, <Thread(Thread-7 (_runner), started daemon 131673722322112)>, <Thread(fd_logger, started daemon 131673722585024)>, <Thread(privsep_reader, started daemon 131673721593984)>, <Thread(tpool_thread_0, started daemon 131673714706112)>, <Thread(tpool_thread_1, started daemon 131673706313408)>, <Thread(tpool_thread_2, started daemon 131673697920704)>, <Thread(tpool_thread_3, started daemon 131673689528000)>, <Thread(tpool_thread_4, started daemon 131673681135296)>, <Thread(tpool_thread_5, started daemon 131673672726208)>, <Thread(tpool_thread_6, started daemon 131673664317120)>, <Thread(tpool_thread_7, started daemon 131673655908032)>, <Thread(tpool_thread_8, started daemon 131673647498944)>, <Thread(tpool_thread_9, started daemon 131673639089856)>, <Thread(tpool_thread_10, started daemon 131673630680768)>, <Thread(tpool_thread_11, started daemon 131673622271680)>, <Thread(tpool_thread_12, started daemon 131673613862592)>, <Thread(tpool_thread_13, started daemon 131673605453504)>, <Thread(tpool_thread_14, started daemon 131673597044416)>, <Thread(tpool_thread_15, started daemon 131673588635328)>, <Thread(tpool_thread_16, started daemon 131673580226240)>, <Thread(tpool_thread_17, started daemon 131673571817152)>, <Thread(tpool_thread_18, started daemon 131673563408064)>, <Thread(tpool_thread_19, started daemon 131673554998976)>] {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 16:07:49 devstack sudo[106797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-39d9ce77-3e0f-449d-a360-0afc38232651
Sep 04 16:07:49 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:49 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cdababc9-6961-4cad-b22b-fb871d1f2799 1073741824" returned: 0 in 0.505s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cdababc9-6961-4cad-b22b-fb871d1f2799 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:49 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b6d6ccfd-be81-480a-abc6-dea6f82a4bf5 tempest-CreateVolumesFromImageTest-1861563137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-39d9ce77-3e0f-449d-a360-0afc38232651" returned: 0 in 0.422s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b6d6ccfd-be81-480a-abc6-dea6f82a4bf5 tempest-CreateVolumesFromImageTest-1861563137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-39d9ce77-3e0f-449d-a360-0afc38232651 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:49 devstack sudo[106805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cdababc9-6961-4cad-b22b-fb871d1f2799
Sep 04 16:07:49 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:49 devstack sudo[106807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-39d9ce77-3e0f-449d-a360-0afc38232651
Sep 04 16:07:49 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:49 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cdababc9-6961-4cad-b22b-fb871d1f2799" returned: 0 in 0.287s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.091s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abfa0278-b08d-4c73-9a2b-489656a7a89a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='739c9c921a474ae2a31628b048f0c8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:43Z,use_quota=True,user_id='1d0d4946a0004fbe80808657860da441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Creating volume abfa0278-b08d-4c73-9a2b-489656a7a89a {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:07:49 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-abfa0278-b08d-4c73-9a2b-489656a7a89a 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:49 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b6d6ccfd-be81-480a-abc6-dea6f82a4bf5 tempest-CreateVolumesFromImageTest-1861563137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-39d9ce77-3e0f-449d-a360-0afc38232651" returned: 0 in 0.298s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:49 devstack sudo[106811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-abfa0278-b08d-4c73-9a2b-489656a7a89a 1073741824
Sep 04 16:07:49 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e15506a-4bda-46db-8b18-d6d7beaf665f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdababc9-6961-4cad-b22b-fb871d1f2799', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dae86680-85a7-4605-a428-41720637f958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b6d6ccfd-be81-480a-abc6-dea6f82a4bf5 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "cinder-quobyte-39d9ce77-3e0f-449d-a360-0afc38232651" released by "delete_volume" :: held 0.790s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:49 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Volume volume-cdababc9-6961-4cad-b22b-fb871d1f2799 (cdababc9-6961-4cad-b22b-fb871d1f2799): created successfully
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dae86680-85a7-4605-a428-41720637f958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Flow 'volume_create_manager' (d861a395-f4c5-4e9c-8f7b-5fa1d5f80a57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:50 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-89f1850c-ea30-4088-999d-46a940ba32a5 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Created volume successfully.
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-b6d6ccfd-be81-480a-abc6-dea6f82a4bf5 tempest-CreateVolumesFromImageTest-1861563137 None] Created reservations ['ab371b46-abfc-4f47-bf74-c3b3c91b8f78', '237583ac-66fc-4575-9bdc-0680d1a1d046', 'a8a6fc93-b701-4715-9901-c130a646d89c', '34310498-97f2-4358-8650-1ccdd48b37a0'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b6d6ccfd-be81-480a-abc6-dea6f82a4bf5 tempest-CreateVolumesFromImageTest-1861563137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b6d6ccfd-be81-480a-abc6-dea6f82a4bf5 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b6d6ccfd-be81-480a-abc6-dea6f82a4bf5 tempest-CreateVolumesFromImageTest-1861563137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b6d6ccfd-be81-480a-abc6-dea6f82a4bf5 tempest-CreateVolumesFromImageTest-1861563137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b6d6ccfd-be81-480a-abc6-dea6f82a4bf5 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b6d6ccfd-be81-480a-abc6-dea6f82a4bf5 tempest-CreateVolumesFromImageTest-1861563137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:50 devstack sudo[106816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:07:50 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-27abff6c-1f83-4171-95a0-3611102ddc62 tempest-CreateVolumesFromImageTest-1861563137 None] Acquiring lock "cinder-20f9a789-6099-4325-93e6-44956de7a04c-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-27abff6c-1f83-4171-95a0-3611102ddc62 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "cinder-20f9a789-6099-4325-93e6-44956de7a04c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-27abff6c-1f83-4171-95a0-3611102ddc62 tempest-CreateVolumesFromImageTest-1861563137 None] Acquiring lock "cinder-quobyte-20f9a789-6099-4325-93e6-44956de7a04c" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-27abff6c-1f83-4171-95a0-3611102ddc62 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "cinder-quobyte-20f9a789-6099-4325-93e6-44956de7a04c" acquired by "delete_volume" :: waited 0.021s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bca00b-4c67-45e3-bfc1-5b6703a4c42c]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-27abff6c-1f83-4171-95a0-3611102ddc62 tempest-CreateVolumesFromImageTest-1861563137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-20f9a789-6099-4325-93e6-44956de7a04c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:50 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:50 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b6d6ccfd-be81-480a-abc6-dea6f82a4bf5 tempest-CreateVolumesFromImageTest-1861563137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.312s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-b6d6ccfd-be81-480a-abc6-dea6f82a4bf5 tempest-CreateVolumesFromImageTest-1861563137 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:07:50 devstack sudo[106819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-20f9a789-6099-4325-93e6-44956de7a04c
Sep 04 16:07:50 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-abfa0278-b08d-4c73-9a2b-489656a7a89a 1073741824" returned: 0 in 0.575s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:50 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-b6d6ccfd-be81-480a-abc6-dea6f82a4bf5 tempest-CreateVolumesFromImageTest-1861563137 None] Deleted volume successfully.
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-abfa0278-b08d-4c73-9a2b-489656a7a89a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b6d6ccfd-be81-480a-abc6-dea6f82a4bf5 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "cinder-39d9ce77-3e0f-449d-a360-0afc38232651-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:50 devstack sudo[106822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-abfa0278-b08d-4c73-9a2b-489656a7a89a
Sep 04 16:07:50 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ce40c796-04df-4a29-a68d-3f7215c709bd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "cinder-cdababc9-6961-4cad-b22b-fb871d1f2799-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ce40c796-04df-4a29-a68d-3f7215c709bd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "cinder-cdababc9-6961-4cad-b22b-fb871d1f2799-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ce40c796-04df-4a29-a68d-3f7215c709bd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "cinder-quobyte-cdababc9-6961-4cad-b22b-fb871d1f2799" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ce40c796-04df-4a29-a68d-3f7215c709bd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "cinder-quobyte-cdababc9-6961-4cad-b22b-fb871d1f2799" acquired by "delete_volume" :: waited 0.019s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[07080eac-c0d1-4e81-a316-702d0b09a3e7]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce40c796-04df-4a29-a68d-3f7215c709bd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cdababc9-6961-4cad-b22b-fb871d1f2799 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:50 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-27abff6c-1f83-4171-95a0-3611102ddc62 tempest-CreateVolumesFromImageTest-1861563137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-20f9a789-6099-4325-93e6-44956de7a04c" returned: 0 in 0.435s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-27abff6c-1f83-4171-95a0-3611102ddc62 tempest-CreateVolumesFromImageTest-1861563137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-20f9a789-6099-4325-93e6-44956de7a04c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:50 devstack sudo[106824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cdababc9-6961-4cad-b22b-fb871d1f2799
Sep 04 16:07:50 devstack sudo[106828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-20f9a789-6099-4325-93e6-44956de7a04c
Sep 04 16:07:50 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:50 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:50 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-abfa0278-b08d-4c73-9a2b-489656a7a89a" returned: 0 in 0.321s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.185s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd3ed11-05e6-4165-a2b3-2e0a87e00e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ea54ef661c744539a85398472a475dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:44Z,use_quota=True,user_id='2d82ca988df14268a3f44c8c4674b492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39113aae-dab5-4fbc-9aa7-a3e4a030e8e1),volume_type_id=39113aae-dab5-4fbc-9aa7-a3e4a030e8e1)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Creating volume dfd3ed11-05e6-4165-a2b3-2e0a87e00e56 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:07:50 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:50 devstack sudo[106832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56 1073741824
Sep 04 16:07:50 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Attempting download of 92e3f49f-28ed-41c4-8374-1b3ef5194e28 ((None, [{'url': 'file:///opt/stack/data/glance/images/92e3f49f-28ed-41c4-8374-1b3ef5194e28', 'metadata': {}}])) to volume abfa0278-b08d-4c73-9a2b-489656a7a89a. {{(pid=87504) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb02910e-92d8-4585-b8ba-a5d8f7c7e477]: (4, 'raw') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92e3f49f-28ed-41c4-8374-1b3ef5194e28_tsqry0xp {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:51 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-27abff6c-1f83-4171-95a0-3611102ddc62 tempest-CreateVolumesFromImageTest-1861563137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-20f9a789-6099-4325-93e6-44956de7a04c" returned: 0 in 0.285s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-27abff6c-1f83-4171-95a0-3611102ddc62 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "cinder-quobyte-20f9a789-6099-4325-93e6-44956de7a04c" released by "delete_volume" :: held 0.763s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:51 devstack sudo[106834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92e3f49f-28ed-41c4-8374-1b3ef5194e28_tsqry0xp
Sep 04 16:07:51 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:51 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce40c796-04df-4a29-a68d-3f7215c709bd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cdababc9-6961-4cad-b22b-fb871d1f2799" returned: 0 in 0.439s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce40c796-04df-4a29-a68d-3f7215c709bd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cdababc9-6961-4cad-b22b-fb871d1f2799 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:51 devstack sudo[106842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cdababc9-6961-4cad-b22b-fb871d1f2799
Sep 04 16:07:51 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-27abff6c-1f83-4171-95a0-3611102ddc62 tempest-CreateVolumesFromImageTest-1861563137 None] Created reservations ['ad421dca-f05f-4db2-ab8e-797f9e2883b1', '1275cb9d-08e2-4cfd-ac2e-f5b7add1ac13', 'b0252270-f5df-464e-aecf-c5e3bdf0856b', '3006ef0b-d1e6-454b-93a4-2b90077b45ad'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-27abff6c-1f83-4171-95a0-3611102ddc62 tempest-CreateVolumesFromImageTest-1861563137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-27abff6c-1f83-4171-95a0-3611102ddc62 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-27abff6c-1f83-4171-95a0-3611102ddc62 tempest-CreateVolumesFromImageTest-1861563137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-27abff6c-1f83-4171-95a0-3611102ddc62 tempest-CreateVolumesFromImageTest-1861563137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-27abff6c-1f83-4171-95a0-3611102ddc62 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-27abff6c-1f83-4171-95a0-3611102ddc62 tempest-CreateVolumesFromImageTest-1861563137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:51 devstack sudo[106845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:07:51 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:51 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92e3f49f-28ed-41c4-8374-1b3ef5194e28_tsqry0xp" returned: 0 in 0.438s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92e3f49f-28ed-41c4-8374-1b3ef5194e28_tsqry0xp {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:51 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56 1073741824" returned: 0 in 0.547s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dc3e1375-9a7a-4cc3-a08d-d25479aa7302 tempest-CreateVolumesFromImageTest-1861563137 None] Acquiring lock "cinder-79eae3b4-4e13-457b-b6b7-354023a6f5ee-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dc3e1375-9a7a-4cc3-a08d-d25479aa7302 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "cinder-79eae3b4-4e13-457b-b6b7-354023a6f5ee-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:51 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce40c796-04df-4a29-a68d-3f7215c709bd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cdababc9-6961-4cad-b22b-fb871d1f2799" returned: 0 in 0.393s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:51 devstack sudo[106852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56
Sep 04 16:07:51 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ce40c796-04df-4a29-a68d-3f7215c709bd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "cinder-quobyte-cdababc9-6961-4cad-b22b-fb871d1f2799" released by "delete_volume" :: held 0.901s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dc3e1375-9a7a-4cc3-a08d-d25479aa7302 tempest-CreateVolumesFromImageTest-1861563137 None] Acquiring lock "cinder-quobyte-79eae3b4-4e13-457b-b6b7-354023a6f5ee" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:51 devstack sudo[106851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92e3f49f-28ed-41c4-8374-1b3ef5194e28_tsqry0xp
Sep 04 16:07:51 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dc3e1375-9a7a-4cc3-a08d-d25479aa7302 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "cinder-quobyte-79eae3b4-4e13-457b-b6b7-354023a6f5ee" acquired by "delete_volume" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20d3d0e-8408-43a1-b776-497be9bb8532]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc3e1375-9a7a-4cc3-a08d-d25479aa7302 tempest-CreateVolumesFromImageTest-1861563137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-79eae3b4-4e13-457b-b6b7-354023a6f5ee {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:51 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-27abff6c-1f83-4171-95a0-3611102ddc62 tempest-CreateVolumesFromImageTest-1861563137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.377s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-27abff6c-1f83-4171-95a0-3611102ddc62 tempest-CreateVolumesFromImageTest-1861563137 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:07:51 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-27abff6c-1f83-4171-95a0-3611102ddc62 tempest-CreateVolumesFromImageTest-1861563137 None] Deleted volume successfully.
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-27abff6c-1f83-4171-95a0-3611102ddc62 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "cinder-20f9a789-6099-4325-93e6-44956de7a04c-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-ce40c796-04df-4a29-a68d-3f7215c709bd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Created reservations ['a557f4d3-b3e9-4246-a1aa-162bde7816c3', 'a7dcf0e0-ad2a-4cd8-8d9f-bd70720543e5', 'f2bde3da-6649-4138-96c7-e1188b432fe0', '74c9d60d-7718-40aa-ae0d-b2fd53ddd0b6'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ce40c796-04df-4a29-a68d-3f7215c709bd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ce40c796-04df-4a29-a68d-3f7215c709bd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ce40c796-04df-4a29-a68d-3f7215c709bd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ce40c796-04df-4a29-a68d-3f7215c709bd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ce40c796-04df-4a29-a68d-3f7215c709bd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce40c796-04df-4a29-a68d-3f7215c709bd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:51 devstack sudo[106856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-79eae3b4-4e13-457b-b6b7-354023a6f5ee
Sep 04 16:07:51 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:51 devstack sudo[106857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:07:51 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:51 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92e3f49f-28ed-41c4-8374-1b3ef5194e28_tsqry0xp" returned: 1 in 0.487s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92e3f49f-28ed-41c4-8374-1b3ef5194e28_tsqry0xp' failed. Not Retrying. {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6919e5c4-f677-4031-af2d-92b36f4ad565]: (4, 'raw') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:51 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56" returned: 0 in 0.408s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:51 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Attempting download of 04bb8204-b734-4c31-ae1b-fc7dde1c7c99 ((None, [{'url': 'file:///opt/stack/data/glance/images/04bb8204-b734-4c31-ae1b-fc7dde1c7c99', 'metadata': {}}])) to volume dfd3ed11-05e6-4165-a2b3-2e0a87e00e56. {{(pid=87504) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2ec443-8038-4ac9-833a-cd646793f5bf]: (4, 'raw') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_3n1sobco {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:52 devstack sudo[106863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD
Sep 04 16:07:52 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:52 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ce40c796-04df-4a29-a68d-3f7215c709bd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.316s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ce40c796-04df-4a29-a68d-3f7215c709bd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:07:52 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-ce40c796-04df-4a29-a68d-3f7215c709bd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Deleted volume successfully.
Sep 04 16:07:52 devstack sudo[106864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_3n1sobco
Sep 04 16:07:52 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:52 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc3e1375-9a7a-4cc3-a08d-d25479aa7302 tempest-CreateVolumesFromImageTest-1861563137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-79eae3b4-4e13-457b-b6b7-354023a6f5ee" returned: 0 in 0.524s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc3e1375-9a7a-4cc3-a08d-d25479aa7302 tempest-CreateVolumesFromImageTest-1861563137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-79eae3b4-4e13-457b-b6b7-354023a6f5ee {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ce40c796-04df-4a29-a68d-3f7215c709bd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "cinder-cdababc9-6961-4cad-b22b-fb871d1f2799-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:52 devstack sudo[106871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-79eae3b4-4e13-457b-b6b7-354023a6f5ee
Sep 04 16:07:52 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:52 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:52 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_3n1sobco" returned: 0 in 0.364s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_3n1sobco {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:52 devstack sudo[106875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD
Sep 04 16:07:52 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:52 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc3e1375-9a7a-4cc3-a08d-d25479aa7302 tempest-CreateVolumesFromImageTest-1861563137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-79eae3b4-4e13-457b-b6b7-354023a6f5ee" returned: 0 in 0.289s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dc3e1375-9a7a-4cc3-a08d-d25479aa7302 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "cinder-quobyte-79eae3b4-4e13-457b-b6b7-354023a6f5ee" released by "delete_volume" :: held 0.872s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:52 devstack sudo[106878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_3n1sobco
Sep 04 16:07:52 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-dc3e1375-9a7a-4cc3-a08d-d25479aa7302 tempest-CreateVolumesFromImageTest-1861563137 None] Created reservations ['df4eb6af-3bcc-4465-8a5d-54e6cec0766b', '9711e46b-0315-4ff6-87e5-fbb9125f503c', 'fce889c8-0533-4310-998a-79568b27c851', '11263274-6f2f-4fcb-9a49-965a8acaf21c'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-dc3e1375-9a7a-4cc3-a08d-d25479aa7302 tempest-CreateVolumesFromImageTest-1861563137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-dc3e1375-9a7a-4cc3-a08d-d25479aa7302 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-dc3e1375-9a7a-4cc3-a08d-d25479aa7302 tempest-CreateVolumesFromImageTest-1861563137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-dc3e1375-9a7a-4cc3-a08d-d25479aa7302 tempest-CreateVolumesFromImageTest-1861563137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-dc3e1375-9a7a-4cc3-a08d-d25479aa7302 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc3e1375-9a7a-4cc3-a08d-d25479aa7302 tempest-CreateVolumesFromImageTest-1861563137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:52 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD" returned: 1 in 0.358s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] 92e3f49f-28ed-41c4-8374-1b3ef5194e28 was raw, converting to qcow2 {{(pid=87504) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-abfa0278-b08d-4c73-9a2b-489656a7a89a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:52 devstack sudo[106885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:07:52 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:52 devstack sudo[106886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-abfa0278-b08d-4c73-9a2b-489656a7a89a
Sep 04 16:07:52 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:52 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_3n1sobco" returned: 1 in 0.383s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_3n1sobco' failed. Not Retrying. {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0b32cd-7d68-456f-9c11-e2f1082bd264]: (4, 'raw') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:52 devstack sudo[106891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD
Sep 04 16:07:52 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:52 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-952c59a5-b5dc-4301-99c3-3fe0accaf4d0 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "cinder-e551ffdc-e27b-4354-a3e6-d4f35eb3e78d-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc3e1375-9a7a-4cc3-a08d-d25479aa7302 tempest-CreateVolumesFromImageTest-1861563137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.325s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-dc3e1375-9a7a-4cc3-a08d-d25479aa7302 tempest-CreateVolumesFromImageTest-1861563137 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:07:52 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-dc3e1375-9a7a-4cc3-a08d-d25479aa7302 tempest-CreateVolumesFromImageTest-1861563137 None] Deleted volume successfully.
Sep 04 16:07:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-952c59a5-b5dc-4301-99c3-3fe0accaf4d0 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "cinder-e551ffdc-e27b-4354-a3e6-d4f35eb3e78d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-dc3e1375-9a7a-4cc3-a08d-d25479aa7302 tempest-CreateVolumesFromImageTest-1861563137 None] Lock "cinder-79eae3b4-4e13-457b-b6b7-354023a6f5ee-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-952c59a5-b5dc-4301-99c3-3fe0accaf4d0 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "cinder-quobyte-e551ffdc-e27b-4354-a3e6-d4f35eb3e78d" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-952c59a5-b5dc-4301-99c3-3fe0accaf4d0 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "cinder-quobyte-e551ffdc-e27b-4354-a3e6-d4f35eb3e78d" acquired by "delete_volume" :: waited 0.017s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ec56f0-eeca-4e50-af77-41a7c08d12fe]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-952c59a5-b5dc-4301-99c3-3fe0accaf4d0 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e551ffdc-e27b-4354-a3e6-d4f35eb3e78d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:53 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:53 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:53 devstack sudo[106897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e551ffdc-e27b-4354-a3e6-d4f35eb3e78d
Sep 04 16:07:53 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-abfa0278-b08d-4c73-9a2b-489656a7a89a" returned: 0 in 0.586s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_92e3f49f-28ed-41c4-8374-1b3ef5194e28_cp9a2jqfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-abfa0278-b08d-4c73-9a2b-489656a7a89a {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 16:07:53 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Converted 0.00 MB image at 0.00 MB/s
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-abfa0278-b08d-4c73-9a2b-489656a7a89a 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:53 devstack sudo[106903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-abfa0278-b08d-4c73-9a2b-489656a7a89a 1G
Sep 04 16:07:53 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:53 devstack sudo[106901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD
Sep 04 16:07:53 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:53 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-952c59a5-b5dc-4301-99c3-3fe0accaf4d0 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e551ffdc-e27b-4354-a3e6-d4f35eb3e78d" returned: 0 in 0.440s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-952c59a5-b5dc-4301-99c3-3fe0accaf4d0 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e551ffdc-e27b-4354-a3e6-d4f35eb3e78d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:53 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD" returned: 1 in 0.375s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] 04bb8204-b734-4c31-ae1b-fc7dde1c7c99 was raw, converting to qcow2 {{(pid=87504) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:53 devstack sudo[106916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e551ffdc-e27b-4354-a3e6-d4f35eb3e78d
Sep 04 16:07:53 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:53 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:53 devstack sudo[106917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56
Sep 04 16:07:53 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-abfa0278-b08d-4c73-9a2b-489656a7a89a 1G" returned: 0 in 0.351s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Downloaded image 92e3f49f-28ed-41c4-8374-1b3ef5194e28 ((None, [{'url': 'file:///opt/stack/data/glance/images/92e3f49f-28ed-41c4-8374-1b3ef5194e28', 'metadata': {}}])) to volume abfa0278-b08d-4c73-9a2b-489656a7a89a successfully. {{(pid=87504) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Temporary image 92e3f49f-28ed-41c4-8374-1b3ef5194e28 for user 1d0d4946a0004fbe80808657860da441 is deleted. {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Marking volume abfa0278-b08d-4c73-9a2b-489656a7a89a as bootable. {{(pid=87504) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Copying metadata from image 92e3f49f-28ed-41c4-8374-1b3ef5194e28 to abfa0278-b08d-4c73-9a2b-489656a7a89a. {{(pid=87504) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Creating volume glance metadata for volume abfa0278-b08d-4c73-9a2b-489656a7a89a backed by image 92e3f49f-28ed-41c4-8374-1b3ef5194e28 with: {'image_id': '92e3f49f-28ed-41c4-8374-1b3ef5194e28', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5fbc13cbe8dbfe6ca5be4d16ff05f5ed', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87504) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-aa334414-b7f5-486d-9aa6-9879e694c4fe tempest-CreateVolumesFromImageTest-1861563137 None] Acquiring lock "cinder-b4daa2e0-3666-4e26-bef5-e06c18add1cb-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401fd56c-b8a9-4fa8-ac83-7e087cbeefd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abfa0278-b08d-4c73-9a2b-489656a7a89a', 'volume_size': 1, 'image_id': '92e3f49f-28ed-41c4-8374-1b3ef5194e28', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92e3f49f-28ed-41c4-8374-1b3ef5194e28', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5fbc13cbe8dbfe6ca5be4d16ff05f5ed', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '739c9c921a474ae2a31628b048f0c8c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '26f21a6991cc996271fc037daeb299edd1f560059773c6fc746b6f78eb31a3c2fa8f0c48d92900f934f6c03df03652d9f0c66da1136873759831614967170da8', 'id': '92e3f49f-28ed-41c4-8374-1b3ef5194e28', 'created_at': datetime.datetime(2026, 9, 4, 14, 7, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 7, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92e3f49f-28ed-41c4-8374-1b3ef5194e28/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1ad773470>}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d798a112-70e4-4737-990c-a6a02ddbd502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-aa334414-b7f5-486d-9aa6-9879e694c4fe tempest-CreateVolumesFromImageTest-1861563137 None] Lock "cinder-b4daa2e0-3666-4e26-bef5-e06c18add1cb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:53 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Volume volume-abfa0278-b08d-4c73-9a2b-489656a7a89a (abfa0278-b08d-4c73-9a2b-489656a7a89a): created successfully
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d798a112-70e4-4737-990c-a6a02ddbd502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Flow 'volume_create_manager' (b45f7243-18fb-447c-93a8-d79124ce04a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:53 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-cceb7dd9-b970-4555-95c1-95891b977341 tempest-VolumeImageDependencyTests-250021049 None] Created volume successfully.
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-aa334414-b7f5-486d-9aa6-9879e694c4fe tempest-CreateVolumesFromImageTest-1861563137 None] Acquiring lock "cinder-quobyte-b4daa2e0-3666-4e26-bef5-e06c18add1cb" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-aa334414-b7f5-486d-9aa6-9879e694c4fe tempest-CreateVolumesFromImageTest-1861563137 None] Lock "cinder-quobyte-b4daa2e0-3666-4e26-bef5-e06c18add1cb" acquired by "delete_volume" :: waited 0.025s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eef0d25-05e4-421e-91c0-6c1e4411152c]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-aa334414-b7f5-486d-9aa6-9879e694c4fe tempest-CreateVolumesFromImageTest-1861563137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b4daa2e0-3666-4e26-bef5-e06c18add1cb {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:53 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-952c59a5-b5dc-4301-99c3-3fe0accaf4d0 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e551ffdc-e27b-4354-a3e6-d4f35eb3e78d" returned: 0 in 0.343s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-952c59a5-b5dc-4301-99c3-3fe0accaf4d0 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "cinder-quobyte-e551ffdc-e27b-4354-a3e6-d4f35eb3e78d" released by "delete_volume" :: held 0.831s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:53 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-952c59a5-b5dc-4301-99c3-3fe0accaf4d0 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Created reservations ['3a58e7a3-e37d-4506-8760-8e35bd8a21ff', '607dfae4-7a27-4365-9675-d04678f04b8f', 'a07a5681-1df8-43e1-8e36-61265eb9c9ca', 'c896d6dd-b39d-4c16-83f4-b6f0b052ad81'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:07:54 devstack sudo[106923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b4daa2e0-3666-4e26-bef5-e06c18add1cb
Sep 04 16:07:54 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-952c59a5-b5dc-4301-99c3-3fe0accaf4d0 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-952c59a5-b5dc-4301-99c3-3fe0accaf4d0 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-952c59a5-b5dc-4301-99c3-3fe0accaf4d0 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-952c59a5-b5dc-4301-99c3-3fe0accaf4d0 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-952c59a5-b5dc-4301-99c3-3fe0accaf4d0 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-952c59a5-b5dc-4301-99c3-3fe0accaf4d0 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:54 devstack sudo[106926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:07:54 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-55474a9c-9b8e-47c2-a7f8-b21f1345e700 tempest-VolumeImageDependencyTests-250021049 None] Acquiring lock "cinder-abfa0278-b08d-4c73-9a2b-489656a7a89a-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-016d6929-45c3-4f9f-8f42-9a20f84786dd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "cinder-2187e4fd-1622-46d4-8d75-3bb136927c9c-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:54 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56" returned: 0 in 0.711s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_04bb8204-b734-4c31-ae1b-fc7dde1c7c99_5eby1jrudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56 {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 16:07:54 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Converted 0.00 MB image at 0.00 MB/s
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-016d6929-45c3-4f9f-8f42-9a20f84786dd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "cinder-2187e4fd-1622-46d4-8d75-3bb136927c9c-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-55474a9c-9b8e-47c2-a7f8-b21f1345e700 tempest-VolumeImageDependencyTests-250021049 None] Lock "cinder-abfa0278-b08d-4c73-9a2b-489656a7a89a-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:54 devstack sudo[106928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56 1G
Sep 04 16:07:54 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-55474a9c-9b8e-47c2-a7f8-b21f1345e700 tempest-VolumeImageDependencyTests-250021049 None] Acquiring lock "cinder-quobyte-abfa0278-b08d-4c73-9a2b-489656a7a89a" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-016d6929-45c3-4f9f-8f42-9a20f84786dd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "cinder-quobyte-2187e4fd-1622-46d4-8d75-3bb136927c9c" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-016d6929-45c3-4f9f-8f42-9a20f84786dd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "cinder-quobyte-2187e4fd-1622-46d4-8d75-3bb136927c9c" acquired by "delete_volume" :: waited 0.024s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-55474a9c-9b8e-47c2-a7f8-b21f1345e700 tempest-VolumeImageDependencyTests-250021049 None] Lock "cinder-quobyte-abfa0278-b08d-4c73-9a2b-489656a7a89a" acquired by "delete_volume" :: waited 0.050s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:54 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85f52c3-f66d-42fb-bb17-4afe16ec403f]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-016d6929-45c3-4f9f-8f42-9a20f84786dd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2187e4fd-1622-46d4-8d75-3bb136927c9c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebebebd7-f1db-4130-a1e9-829fd72815ef]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-55474a9c-9b8e-47c2-a7f8-b21f1345e700 tempest-VolumeImageDependencyTests-250021049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-abfa0278-b08d-4c73-9a2b-489656a7a89a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:54 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-aa334414-b7f5-486d-9aa6-9879e694c4fe tempest-CreateVolumesFromImageTest-1861563137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b4daa2e0-3666-4e26-bef5-e06c18add1cb" returned: 0 in 0.605s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-aa334414-b7f5-486d-9aa6-9879e694c4fe tempest-CreateVolumesFromImageTest-1861563137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b4daa2e0-3666-4e26-bef5-e06c18add1cb {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-952c59a5-b5dc-4301-99c3-3fe0accaf4d0 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.414s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-952c59a5-b5dc-4301-99c3-3fe0accaf4d0 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:07:54 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-952c59a5-b5dc-4301-99c3-3fe0accaf4d0 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Deleted volume successfully.
Sep 04 16:07:54 devstack sudo[106936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b4daa2e0-3666-4e26-bef5-e06c18add1cb
Sep 04 16:07:54 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-952c59a5-b5dc-4301-99c3-3fe0accaf4d0 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "cinder-e551ffdc-e27b-4354-a3e6-d4f35eb3e78d-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:54 devstack sudo[106934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2187e4fd-1622-46d4-8d75-3bb136927c9c
Sep 04 16:07:54 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:54 devstack sudo[106935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-abfa0278-b08d-4c73-9a2b-489656a7a89a
Sep 04 16:07:54 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:54 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56 1G" returned: 0 in 0.444s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Downloaded image 04bb8204-b734-4c31-ae1b-fc7dde1c7c99 ((None, [{'url': 'file:///opt/stack/data/glance/images/04bb8204-b734-4c31-ae1b-fc7dde1c7c99', 'metadata': {}}])) to volume dfd3ed11-05e6-4165-a2b3-2e0a87e00e56 successfully. {{(pid=87504) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Temporary image 04bb8204-b734-4c31-ae1b-fc7dde1c7c99 for user 2d82ca988df14268a3f44c8c4674b492 is deleted. {{(pid=87504) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG cinder.volume.volume_utils [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Marking volume dfd3ed11-05e6-4165-a2b3-2e0a87e00e56 as bootable. {{(pid=87504) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Copying metadata from image 04bb8204-b734-4c31-ae1b-fc7dde1c7c99 to dfd3ed11-05e6-4165-a2b3-2e0a87e00e56. {{(pid=87504) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Creating volume glance metadata for volume dfd3ed11-05e6-4165-a2b3-2e0a87e00e56 backed by image 04bb8204-b734-4c31-ae1b-fc7dde1c7c99 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '04bb8204-b734-4c31-ae1b-fc7dde1c7c99', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '18fbfc36a3a7f22dc07b864634397142', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87504) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 04 16:07:54 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-aa334414-b7f5-486d-9aa6-9879e694c4fe tempest-CreateVolumesFromImageTest-1861563137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b4daa2e0-3666-4e26-bef5-e06c18add1cb" returned: 0 in 0.353s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-aa334414-b7f5-486d-9aa6-9879e694c4fe tempest-CreateVolumesFromImageTest-1861563137 None] Lock "cinder-quobyte-b4daa2e0-3666-4e26-bef5-e06c18add1cb" released by "delete_volume" :: held 1.014s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa376f7-8ec7-4f4a-88e3-b8db131c7e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56', 'volume_size': 1, 'image_id': '04bb8204-b734-4c31-ae1b-fc7dde1c7c99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04bb8204-b734-4c31-ae1b-fc7dde1c7c99', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '18fbfc36a3a7f22dc07b864634397142', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0ea54ef661c744539a85398472a475dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '11729f8ac2ff1703b4083c95adbef3c4976fadcac904aa25fddf053202aa9037e50321e678e2a778706c794465db63f9937e6d17e584148e8d3267f49c86f7b3', 'id': '04bb8204-b734-4c31-ae1b-fc7dde1c7c99', 'created_at': datetime.datetime(2026, 9, 4, 14, 7, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 7, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04bb8204-b734-4c31-ae1b-fc7dde1c7c99/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77c1ad0b0ec0>}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b14f4dc-ad66-4ded-b534-d1444870e33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:07:54 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Volume volume-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56 (dfd3ed11-05e6-4165-a2b3-2e0a87e00e56): created successfully
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b14f4dc-ad66-4ded-b534-d1444870e33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:07:54 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Flow 'volume_create_manager' (284f8006-3a1a-4ac1-9337-3670a36f270e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-016d6929-45c3-4f9f-8f42-9a20f84786dd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2187e4fd-1622-46d4-8d75-3bb136927c9c" returned: 0 in 0.527s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-016d6929-45c3-4f9f-8f42-9a20f84786dd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2187e4fd-1622-46d4-8d75-3bb136927c9c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:54 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-cf0f359e-2a49-44eb-b0f4-49d2efc27016 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Created volume successfully.
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-aa334414-b7f5-486d-9aa6-9879e694c4fe tempest-CreateVolumesFromImageTest-1861563137 None] Created reservations ['c5161252-945e-46b2-9293-452be162bd65', '654dc28f-eee1-440a-b6b0-15961706d268', 'c92d66b4-fda5-48d3-a6b0-9d126f818974', '5b7b73d7-9b0b-4658-bfa6-b4df9009200c'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:07:55 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:55 devstack sudo[106953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2187e4fd-1622-46d4-8d75-3bb136927c9c
Sep 04 16:07:55 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-55474a9c-9b8e-47c2-a7f8-b21f1345e700 tempest-VolumeImageDependencyTests-250021049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-abfa0278-b08d-4c73-9a2b-489656a7a89a" returned: 0 in 0.553s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-55474a9c-9b8e-47c2-a7f8-b21f1345e700 tempest-VolumeImageDependencyTests-250021049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-abfa0278-b08d-4c73-9a2b-489656a7a89a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:55 devstack sudo[106955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-abfa0278-b08d-4c73-9a2b-489656a7a89a
Sep 04 16:07:55 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-aa334414-b7f5-486d-9aa6-9879e694c4fe tempest-CreateVolumesFromImageTest-1861563137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-aa334414-b7f5-486d-9aa6-9879e694c4fe tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-aa334414-b7f5-486d-9aa6-9879e694c4fe tempest-CreateVolumesFromImageTest-1861563137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-aa334414-b7f5-486d-9aa6-9879e694c4fe tempest-CreateVolumesFromImageTest-1861563137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-aa334414-b7f5-486d-9aa6-9879e694c4fe tempest-CreateVolumesFromImageTest-1861563137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-aa334414-b7f5-486d-9aa6-9879e694c4fe tempest-CreateVolumesFromImageTest-1861563137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:55 devstack sudo[106957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:07:55 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:55 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-016d6929-45c3-4f9f-8f42-9a20f84786dd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2187e4fd-1622-46d4-8d75-3bb136927c9c" returned: 0 in 0.277s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-016d6929-45c3-4f9f-8f42-9a20f84786dd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "cinder-quobyte-2187e4fd-1622-46d4-8d75-3bb136927c9c" released by "delete_volume" :: held 0.849s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:55 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-55474a9c-9b8e-47c2-a7f8-b21f1345e700 tempest-VolumeImageDependencyTests-250021049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-abfa0278-b08d-4c73-9a2b-489656a7a89a" returned: 0 in 0.307s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-016d6929-45c3-4f9f-8f42-9a20f84786dd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Created reservations ['849ee359-0e2d-4945-a03b-22599594e97b', '02bd41f5-389a-4f14-8b33-3cfefed19df0', 'b3482b42-d212-4acc-a91e-afc0f1c10a6a', 'bc6e465b-6134-4980-b8b9-15b7bb3f1731'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-55474a9c-9b8e-47c2-a7f8-b21f1345e700 tempest-VolumeImageDependencyTests-250021049 None] Lock "cinder-quobyte-abfa0278-b08d-4c73-9a2b-489656a7a89a" released by "delete_volume" :: held 0.926s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:55 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-aa334414-b7f5-486d-9aa6-9879e694c4fe tempest-CreateVolumesFromImageTest-1861563137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.323s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-aa334414-b7f5-486d-9aa6-9879e694c4fe tempest-CreateVolumesFromImageTest-1861563137 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:07:55 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-aa334414-b7f5-486d-9aa6-9879e694c4fe tempest-CreateVolumesFromImageTest-1861563137 None] Deleted volume successfully.
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-016d6929-45c3-4f9f-8f42-9a20f84786dd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-016d6929-45c3-4f9f-8f42-9a20f84786dd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-016d6929-45c3-4f9f-8f42-9a20f84786dd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-016d6929-45c3-4f9f-8f42-9a20f84786dd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-016d6929-45c3-4f9f-8f42-9a20f84786dd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-016d6929-45c3-4f9f-8f42-9a20f84786dd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fe9411a6-ffde-4d80-8e72-c241aaffb758 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Acquiring lock "cinder-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:55 devstack sudo[106962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:07:55 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-55474a9c-9b8e-47c2-a7f8-b21f1345e700 tempest-VolumeImageDependencyTests-250021049 None] Created reservations ['4f408225-f258-4bf4-b936-9512716addbe', 'df20bd58-1665-428f-83f5-13bee01eeba4', '88cc8274-6ec8-4bdb-90a1-8d6f99d7039a', '462b8701-ed33-4503-a61c-34cedf2b1b85'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-aa334414-b7f5-486d-9aa6-9879e694c4fe tempest-CreateVolumesFromImageTest-1861563137 None] Lock "cinder-b4daa2e0-3666-4e26-bef5-e06c18add1cb-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-97ba3e82-fa47-4bca-a8e7-0262bbcce6ef tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "cinder-beb2d3af-c468-4845-b293-06418e90d86f-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fe9411a6-ffde-4d80-8e72-c241aaffb758 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Lock "cinder-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-97ba3e82-fa47-4bca-a8e7-0262bbcce6ef tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "cinder-beb2d3af-c468-4845-b293-06418e90d86f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fe9411a6-ffde-4d80-8e72-c241aaffb758 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Acquiring lock "cinder-quobyte-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-97ba3e82-fa47-4bca-a8e7-0262bbcce6ef tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "cinder-quobyte-beb2d3af-c468-4845-b293-06418e90d86f" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fe9411a6-ffde-4d80-8e72-c241aaffb758 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Lock "cinder-quobyte-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56" acquired by "delete_volume" :: waited 0.044s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a914f9-2bf8-4194-84d5-60e26cbd0608]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fe9411a6-ffde-4d80-8e72-c241aaffb758 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-97ba3e82-fa47-4bca-a8e7-0262bbcce6ef tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "cinder-quobyte-beb2d3af-c468-4845-b293-06418e90d86f" acquired by "delete_volume" :: waited 0.055s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-55474a9c-9b8e-47c2-a7f8-b21f1345e700 tempest-VolumeImageDependencyTests-250021049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-55474a9c-9b8e-47c2-a7f8-b21f1345e700 tempest-VolumeImageDependencyTests-250021049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-55474a9c-9b8e-47c2-a7f8-b21f1345e700 tempest-VolumeImageDependencyTests-250021049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-55474a9c-9b8e-47c2-a7f8-b21f1345e700 tempest-VolumeImageDependencyTests-250021049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-55474a9c-9b8e-47c2-a7f8-b21f1345e700 tempest-VolumeImageDependencyTests-250021049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-55474a9c-9b8e-47c2-a7f8-b21f1345e700 tempest-VolumeImageDependencyTests-250021049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb24417b-d228-41b3-a91a-e462af15e65d]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-97ba3e82-fa47-4bca-a8e7-0262bbcce6ef tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-beb2d3af-c468-4845-b293-06418e90d86f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:55 devstack sudo[106966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:07:55 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:55 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-016d6929-45c3-4f9f-8f42-9a20f84786dd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.322s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-016d6929-45c3-4f9f-8f42-9a20f84786dd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:07:55 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-016d6929-45c3-4f9f-8f42-9a20f84786dd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Deleted volume successfully.
Sep 04 16:07:55 devstack sudo[106964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56
Sep 04 16:07:55 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:55 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-016d6929-45c3-4f9f-8f42-9a20f84786dd tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "cinder-2187e4fd-1622-46d4-8d75-3bb136927c9c-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:55 devstack sudo[106967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-beb2d3af-c468-4845-b293-06418e90d86f
Sep 04 16:07:55 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:56 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-55474a9c-9b8e-47c2-a7f8-b21f1345e700 tempest-VolumeImageDependencyTests-250021049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.299s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:56 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-55474a9c-9b8e-47c2-a7f8-b21f1345e700 tempest-VolumeImageDependencyTests-250021049 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:07:56 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-55474a9c-9b8e-47c2-a7f8-b21f1345e700 tempest-VolumeImageDependencyTests-250021049 None] Deleted volume successfully.
Sep 04 16:07:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-55474a9c-9b8e-47c2-a7f8-b21f1345e700 tempest-VolumeImageDependencyTests-250021049 None] Lock "cinder-abfa0278-b08d-4c73-9a2b-489656a7a89a-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:56 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fe9411a6-ffde-4d80-8e72-c241aaffb758 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56" returned: 0 in 0.429s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fe9411a6-ffde-4d80-8e72-c241aaffb758 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:56 devstack sudo[106978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56
Sep 04 16:07:56 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:56 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-97ba3e82-fa47-4bca-a8e7-0262bbcce6ef tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-beb2d3af-c468-4845-b293-06418e90d86f" returned: 0 in 0.430s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-97ba3e82-fa47-4bca-a8e7-0262bbcce6ef tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-beb2d3af-c468-4845-b293-06418e90d86f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:56 devstack sudo[106980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-beb2d3af-c468-4845-b293-06418e90d86f
Sep 04 16:07:56 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:56 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fe9411a6-ffde-4d80-8e72-c241aaffb758 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56" returned: 0 in 0.263s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fe9411a6-ffde-4d80-8e72-c241aaffb758 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Lock "cinder-quobyte-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56" released by "delete_volume" :: held 0.750s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:56 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-fe9411a6-ffde-4d80-8e72-c241aaffb758 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Created reservations ['42a08aaf-69ce-4e30-8b55-d0986fad0bda', '2f54e860-b343-49c6-9a51-4bd20bdbb2c8', '6e41ee98-90c6-45f0-bc7f-65a512aa12ca', '428b4f6b-8905-4264-8071-78baea6e6ae5'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:07:56 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-97ba3e82-fa47-4bca-a8e7-0262bbcce6ef tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-beb2d3af-c468-4845-b293-06418e90d86f" returned: 0 in 0.292s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-97ba3e82-fa47-4bca-a8e7-0262bbcce6ef tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "cinder-quobyte-beb2d3af-c468-4845-b293-06418e90d86f" released by "delete_volume" :: held 0.800s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fe9411a6-ffde-4d80-8e72-c241aaffb758 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fe9411a6-ffde-4d80-8e72-c241aaffb758 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-fe9411a6-ffde-4d80-8e72-c241aaffb758 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-fe9411a6-ffde-4d80-8e72-c241aaffb758 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fe9411a6-ffde-4d80-8e72-c241aaffb758 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fe9411a6-ffde-4d80-8e72-c241aaffb758 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:56 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-97ba3e82-fa47-4bca-a8e7-0262bbcce6ef tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Created reservations ['24a56feb-ffd5-44d6-978e-8b5c8942d998', '5dad5d55-cb9e-4b52-b5e9-84d19b6ce1ee', '23e5251c-969a-4693-9e50-b3a6debe8eb3', '77602739-a1c9-4bb6-8aaf-17d6c29da60f'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:07:56 devstack sudo[106984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:07:56 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-97ba3e82-fa47-4bca-a8e7-0262bbcce6ef tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-97ba3e82-fa47-4bca-a8e7-0262bbcce6ef tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-97ba3e82-fa47-4bca-a8e7-0262bbcce6ef tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-97ba3e82-fa47-4bca-a8e7-0262bbcce6ef tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-97ba3e82-fa47-4bca-a8e7-0262bbcce6ef tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-97ba3e82-fa47-4bca-a8e7-0262bbcce6ef tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:56 devstack sudo[106986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:07:56 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:57 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fe9411a6-ffde-4d80-8e72-c241aaffb758 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.415s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:57 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-fe9411a6-ffde-4d80-8e72-c241aaffb758 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:07:57 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-fe9411a6-ffde-4d80-8e72-c241aaffb758 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Deleted volume successfully.
Sep 04 16:07:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fe9411a6-ffde-4d80-8e72-c241aaffb758 tempest-VolumeAndVolumeTypeFromImageTest-1578951392 None] Lock "cinder-dfd3ed11-05e6-4165-a2b3-2e0a87e00e56-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:57 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-97ba3e82-fa47-4bca-a8e7-0262bbcce6ef tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.382s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:57 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-97ba3e82-fa47-4bca-a8e7-0262bbcce6ef tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:07:57 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-97ba3e82-fa47-4bca-a8e7-0262bbcce6ef tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Deleted volume successfully.
Sep 04 16:07:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-97ba3e82-fa47-4bca-a8e7-0262bbcce6ef tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "cinder-beb2d3af-c468-4845-b293-06418e90d86f-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c31c491d-10af-4c3b-a3a7-6a2869c38505 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "cinder-90d88090-21e1-4b9a-b319-2f02da7a3bb7-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c31c491d-10af-4c3b-a3a7-6a2869c38505 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "cinder-90d88090-21e1-4b9a-b319-2f02da7a3bb7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c31c491d-10af-4c3b-a3a7-6a2869c38505 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "cinder-quobyte-90d88090-21e1-4b9a-b319-2f02da7a3bb7" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:58 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c31c491d-10af-4c3b-a3a7-6a2869c38505 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "cinder-quobyte-90d88090-21e1-4b9a-b319-2f02da7a3bb7" acquired by "delete_volume" :: waited 0.022s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:58 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b56410-0dcf-4351-84b4-7da141c87a38]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c31c491d-10af-4c3b-a3a7-6a2869c38505 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-90d88090-21e1-4b9a-b319-2f02da7a3bb7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:58 devstack sudo[106990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-90d88090-21e1-4b9a-b319-2f02da7a3bb7
Sep 04 16:07:58 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:58 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c31c491d-10af-4c3b-a3a7-6a2869c38505 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-90d88090-21e1-4b9a-b319-2f02da7a3bb7" returned: 0 in 0.483s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c31c491d-10af-4c3b-a3a7-6a2869c38505 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-90d88090-21e1-4b9a-b319-2f02da7a3bb7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:58 devstack sudo[106995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-90d88090-21e1-4b9a-b319-2f02da7a3bb7
Sep 04 16:07:58 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:58 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c31c491d-10af-4c3b-a3a7-6a2869c38505 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-90d88090-21e1-4b9a-b319-2f02da7a3bb7" returned: 0 in 0.328s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:58 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c31c491d-10af-4c3b-a3a7-6a2869c38505 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "cinder-quobyte-90d88090-21e1-4b9a-b319-2f02da7a3bb7" released by "delete_volume" :: held 0.865s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:58 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-c31c491d-10af-4c3b-a3a7-6a2869c38505 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Created reservations ['a8e6414f-1f9f-4693-a428-89f8212415d5', 'e88976ef-2d4f-44d2-8315-a49393c7cbe0', 'ad382acc-f9dd-47d6-9d16-147fb6a32ea4', '48fe8dbd-5b27-40dd-b590-0fbb1aede4da'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:07:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c31c491d-10af-4c3b-a3a7-6a2869c38505 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:07:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c31c491d-10af-4c3b-a3a7-6a2869c38505 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:07:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c31c491d-10af-4c3b-a3a7-6a2869c38505 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:07:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c31c491d-10af-4c3b-a3a7-6a2869c38505 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:07:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c31c491d-10af-4c3b-a3a7-6a2869c38505 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:07:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c31c491d-10af-4c3b-a3a7-6a2869c38505 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:59 devstack sudo[106998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:07:59 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bd10f7af-f72b-4bd4-a560-1ed92fb83b94 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "cinder-0b25f520-faac-4d25-a17c-f0135a6de8e6-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bd10f7af-f72b-4bd4-a560-1ed92fb83b94 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "cinder-0b25f520-faac-4d25-a17c-f0135a6de8e6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bd10f7af-f72b-4bd4-a560-1ed92fb83b94 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "cinder-quobyte-0b25f520-faac-4d25-a17c-f0135a6de8e6" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:07:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bd10f7af-f72b-4bd4-a560-1ed92fb83b94 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "cinder-quobyte-0b25f520-faac-4d25-a17c-f0135a6de8e6" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:07:59 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b79069d-0da2-4346-bc4d-00e8becbbdad]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:07:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bd10f7af-f72b-4bd4-a560-1ed92fb83b94 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0b25f520-faac-4d25-a17c-f0135a6de8e6 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:59 devstack sudo[107000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0b25f520-faac-4d25-a17c-f0135a6de8e6
Sep 04 16:07:59 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:07:59 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c31c491d-10af-4c3b-a3a7-6a2869c38505 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.470s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:59 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-c31c491d-10af-4c3b-a3a7-6a2869c38505 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:07:59 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-c31c491d-10af-4c3b-a3a7-6a2869c38505 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Deleted volume successfully.
Sep 04 16:07:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-c31c491d-10af-4c3b-a3a7-6a2869c38505 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "cinder-90d88090-21e1-4b9a-b319-2f02da7a3bb7-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:07:59 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root
Sep 04 16:07:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bd10f7af-f72b-4bd4-a560-1ed92fb83b94 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0b25f520-faac-4d25-a17c-f0135a6de8e6" returned: 0 in 0.484s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:07:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bd10f7af-f72b-4bd4-a560-1ed92fb83b94 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0b25f520-faac-4d25-a17c-f0135a6de8e6 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:07:59 devstack sudo[107006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0b25f520-faac-4d25-a17c-f0135a6de8e6
Sep 04 16:07:59 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:00 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bd10f7af-f72b-4bd4-a560-1ed92fb83b94 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-0b25f520-faac-4d25-a17c-f0135a6de8e6" returned: 0 in 0.425s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bd10f7af-f72b-4bd4-a560-1ed92fb83b94 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "cinder-quobyte-0b25f520-faac-4d25-a17c-f0135a6de8e6" released by "delete_volume" :: held 0.983s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Flow 'volume_create_manager' (3d1102fc-ef68-4438-b629-cfa8881615ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98643dd3-20cc-4549-9ff3-e3e4f904c461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98643dd3-20cc-4549-9ff3-e3e4f904c461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-391263671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6687469a-08df-44a9-ae9f-e6c60d15a9bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5733482120ea4cfd955c2419bdf4aa0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:00Z,use_quota=True,user_id='0b47a7c532b24d1e86b44e7dd453c27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef87f49-f9b2-4fba-b7eb-6e86b85f5634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef87f49-f9b2-4fba-b7eb-6e86b85f5634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36657c1a-b073-4ae6-850e-1ebff2831dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36657c1a-b073-4ae6-850e-1ebff2831dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6687469a-08df-44a9-ae9f-e6c60d15a9bf', 'volume_name': 'volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c70232-bf06-4098-a668-e5e782d67c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c70232-bf06-4098-a668-e5e782d67c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f47586-251b-486a-8478-f86952028713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:00 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Volume 6687469a-08df-44a9-ae9f-e6c60d15a9bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf', 'volume_size': 1}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-391263671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6687469a-08df-44a9-ae9f-e6c60d15a9bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5733482120ea4cfd955c2419bdf4aa0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:00Z,use_quota=True,user_id='0b47a7c532b24d1e86b44e7dd453c27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Creating volume 6687469a-08df-44a9-ae9f-e6c60d15a9bf {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:08:00 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:00 devstack sudo[107009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf 1073741824
Sep 04 16:08:00 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-bd10f7af-f72b-4bd4-a560-1ed92fb83b94 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Created reservations ['2c9c57c3-2ee6-414f-a8ce-1aca14e7a31f', '47593542-9396-4f27-a07d-45030b6802f1', 'd41722de-9dcb-4ae3-a829-3e4ca34a699e', 'eaa6e775-2e82-418b-a374-d1db6102a9a9'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bd10f7af-f72b-4bd4-a560-1ed92fb83b94 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bd10f7af-f72b-4bd4-a560-1ed92fb83b94 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bd10f7af-f72b-4bd4-a560-1ed92fb83b94 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-bd10f7af-f72b-4bd4-a560-1ed92fb83b94 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bd10f7af-f72b-4bd4-a560-1ed92fb83b94 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bd10f7af-f72b-4bd4-a560-1ed92fb83b94 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:00 devstack sudo[107011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:08:00 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:00 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bd10f7af-f72b-4bd4-a560-1ed92fb83b94 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.372s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:00 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-bd10f7af-f72b-4bd4-a560-1ed92fb83b94 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:08:00 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-bd10f7af-f72b-4bd4-a560-1ed92fb83b94 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Deleted volume successfully.
Sep 04 16:08:00 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf 1073741824" returned: 0 in 0.572s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-bd10f7af-f72b-4bd4-a560-1ed92fb83b94 tempest-CreateVolumesFromSourceVolumeTest-221165456 None] Lock "cinder-0b25f520-faac-4d25-a17c-f0135a6de8e6-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:01 devstack sudo[107018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf
Sep 04 16:08:01 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Flow 'volume_create_manager' (3b4aad81-78b4-4ed0-932f-2832524c55eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f5800c-33c6-4e82-a2da-baa3d90d3c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f5800c-33c6-4e82-a2da-baa3d90d3c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56d3036a-d568-46a2-ac23-830600363594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e5e88b966a4c44b9e5b1df8fbf24d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:01Z,use_quota=True,user_id='f98efa07725746af9fd0da849df2d5ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ee0d0c-109b-4aaf-b1a4-306071eebf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ee0d0c-109b-4aaf-b1a4-306071eebf22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ffad1e-756c-4245-996f-6ddd53011e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ffad1e-756c-4245-996f-6ddd53011e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56d3036a-d568-46a2-ac23-830600363594', 'volume_name': 'volume-56d3036a-d568-46a2-ac23-830600363594', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03cfbfff-e322-4ae5-bbb1-9ebf27b37482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03cfbfff-e322-4ae5-bbb1-9ebf27b37482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33eb75e1-35f3-4f4e-a0b2-b868a67d4b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:01 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Volume 56d3036a-d568-46a2-ac23-830600363594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56d3036a-d568-46a2-ac23-830600363594', 'volume_size': 1}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:01 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf" returned: 0 in 0.269s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.088s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56d3036a-d568-46a2-ac23-830600363594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e5e88b966a4c44b9e5b1df8fbf24d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:01Z,use_quota=True,user_id='f98efa07725746af9fd0da849df2d5ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Creating volume 56d3036a-d568-46a2-ac23-830600363594 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:08:01 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-56d3036a-d568-46a2-ac23-830600363594 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f47586-251b-486a-8478-f86952028713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:01 devstack sudo[107021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-56d3036a-d568-46a2-ac23-830600363594 1073741824
Sep 04 16:08:01 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff73432-0303-456e-b104-32f885632127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:01 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Volume volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf (6687469a-08df-44a9-ae9f-e6c60d15a9bf): created successfully
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff73432-0303-456e-b104-32f885632127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Flow 'volume_create_manager' (3d1102fc-ef68-4438-b629-cfa8881615ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:01 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-9c551c1a-aaa6-4c29-8801-d0b9955946e9 tempest-CreateVolumesFromSnapshotTest-842543388 None] Created volume successfully.
Sep 04 16:08:01 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-56d3036a-d568-46a2-ac23-830600363594 1073741824" returned: 0 in 0.515s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-56d3036a-d568-46a2-ac23-830600363594 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:01 devstack sudo[107027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-56d3036a-d568-46a2-ac23-830600363594
Sep 04 16:08:01 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:02 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-56d3036a-d568-46a2-ac23-830600363594" returned: 0 in 0.264s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:02 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:08:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33eb75e1-35f3-4f4e-a0b2-b868a67d4b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56d3036a-d568-46a2-ac23-830600363594', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51aaf1af-3b8e-4e3b-8ef9-7bc0751402ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:02 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Volume volume-56d3036a-d568-46a2-ac23-830600363594 (56d3036a-d568-46a2-ac23-830600363594): created successfully
Sep 04 16:08:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51aaf1af-3b8e-4e3b-8ef9-7bc0751402ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:02 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Flow 'volume_create_manager' (3b4aad81-78b4-4ed0-932f-2832524c55eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:02 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-5c65b902-356d-4f97-9931-0b5814fa9f65 tempest-CinderUnicodeTest-1229689783 None] Created volume successfully.
Sep 04 16:08:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b9fbbe5a-ac0e-42b8-9771-54a51d1709af tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b9fbbe5a-ac0e-42b8-9771-54a51d1709af tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:02 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-b9fbbe5a-ac0e-42b8-9771-54a51d1709af tempest-CreateVolumesFromSnapshotTest-842543388 None] Creating offline snapshot 05d43b92-6e88-4a51-831d-6f25433d9de5 of volume 6687469a-08df-44a9-ae9f-e6c60d15a9bf {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 16:08:02 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f7beb9-6854-4173-88dd-d1864c75b057]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b9fbbe5a-ac0e-42b8-9771-54a51d1709af tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:02 devstack sudo[107030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf
Sep 04 16:08:02 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:03 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b9fbbe5a-ac0e-42b8-9771-54a51d1709af tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf" returned: 0 in 0.435s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b9fbbe5a-ac0e-42b8-9771-54a51d1709af tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.05d43b92-6e88-4a51-831d-6f25433d9de5 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:03 devstack sudo[107035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.05d43b92-6e88-4a51-831d-6f25433d9de5 1G
Sep 04 16:08:03 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:03 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b9fbbe5a-ac0e-42b8-9771-54a51d1709af tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.05d43b92-6e88-4a51-831d-6f25433d9de5 1G" returned: 0 in 0.617s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b9fbbe5a-ac0e-42b8-9771-54a51d1709af tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.05d43b92-6e88-4a51-831d-6f25433d9de5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:03 devstack sudo[107045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.05d43b92-6e88-4a51-831d-6f25433d9de5
Sep 04 16:08:03 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:03 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:08:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Flow 'volume_create_manager' (0d6199a2-9085-408f-a74c-49939d792db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32cfb8af-7c2f-4314-88c3-c1761f75fd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32cfb8af-7c2f-4314-88c3-c1761f75fd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2089494535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c13b36f0-49f9-48e2-8e7c-4e9e2684de88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e5e88b966a4c44b9e5b1df8fbf24d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:04Z,use_quota=True,user_id='f98efa07725746af9fd0da849df2d5ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542a8c82-0890-421e-a36a-597b4848e05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542a8c82-0890-421e-a36a-597b4848e05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec6cc610-36d0-47ef-b4e0-5ed03098cd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec6cc610-36d0-47ef-b4e0-5ed03098cd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c13b36f0-49f9-48e2-8e7c-4e9e2684de88', 'volume_name': 'volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47787b39-f94a-4777-b00a-4919b2223af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47787b39-f94a-4777-b00a-4919b2223af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8911b5-b274-4712-8d52-ccbf7affb500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:04 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Volume c13b36f0-49f9-48e2-8e7c-4e9e2684de88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88', 'volume_size': 1}
Sep 04 16:08:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:04 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b9fbbe5a-ac0e-42b8-9771-54a51d1709af tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.05d43b92-6e88-4a51-831d-6f25433d9de5" returned: 0 in 0.402s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:04 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-b9fbbe5a-ac0e-42b8-9771-54a51d1709af tempest-CreateVolumesFromSnapshotTest-842543388 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.05d43b92-6e88-4a51-831d-6f25433d9de5 is being set with open permissions: ugo+rw
Sep 04 16:08:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b9fbbe5a-ac0e-42b8-9771-54a51d1709af tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.05d43b92-6e88-4a51-831d-6f25433d9de5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:04 devstack sudo[107050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.05d43b92-6e88-4a51-831d-6f25433d9de5
Sep 04 16:08:04 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:04 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b9fbbe5a-ac0e-42b8-9771-54a51d1709af tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.05d43b92-6e88-4a51-831d-6f25433d9de5" returned: 0 in 0.287s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b9fbbe5a-ac0e-42b8-9771-54a51d1709af tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:04 devstack sudo[107053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.info
Sep 04 16:08:04 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:04 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b9fbbe5a-ac0e-42b8-9771-54a51d1709af tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.info" returned: 0 in 0.311s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:04 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-b9fbbe5a-ac0e-42b8-9771-54a51d1709af tempest-CreateVolumesFromSnapshotTest-842543388 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.info is being set with open permissions: ugo+rw
Sep 04 16:08:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b9fbbe5a-ac0e-42b8-9771-54a51d1709af tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:04 devstack sudo[107057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.info
Sep 04 16:08:04 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:04 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b9fbbe5a-ac0e-42b8-9771-54a51d1709af tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.info" returned: 0 in 0.305s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b9fbbe5a-ac0e-42b8-9771-54a51d1709af tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.473s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.034s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2089494535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c13b36f0-49f9-48e2-8e7c-4e9e2684de88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e5e88b966a4c44b9e5b1df8fbf24d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:04Z,use_quota=True,user_id='f98efa07725746af9fd0da849df2d5ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:08:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Creating volume c13b36f0-49f9-48e2-8e7c-4e9e2684de88 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:08:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:08:05 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:08:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:05 devstack sudo[107060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88 1073741824
Sep 04 16:08:05 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:05 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-b9fbbe5a-ac0e-42b8-9771-54a51d1709af tempest-CreateVolumesFromSnapshotTest-842543388 None] Create snapshot completed successfully
Sep 04 16:08:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-bf420513-0dfc-48e5-9ebc-5503b92cddf6 tempest-ProjectAdminTests-178486335 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7594451904297, 'free_capacity_gb': 1773.7594451904297, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87504) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 04 16:08:05 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88 1073741824" returned: 0 in 0.515s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:05 devstack sudo[107066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88
Sep 04 16:08:05 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:05 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88" returned: 0 in 0.309s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:05 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:08:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8911b5-b274-4712-8d52-ccbf7affb500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ab9bae-8bdb-419a-be40-376b1ffb18c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:05 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Volume volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88 (c13b36f0-49f9-48e2-8e7c-4e9e2684de88): created successfully
Sep 04 16:08:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ab9bae-8bdb-419a-be40-376b1ffb18c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Flow 'volume_create_manager' (0d6199a2-9085-408f-a74c-49939d792db2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:06 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-3a94f505-bd26-4993-85b4-c6dcca68982d tempest-CinderUnicodeTest-1229689783 None] Created volume successfully.
Sep 04 16:08:06 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:08:06 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Flow 'volume_create_manager' (9433849f-8b91-4888-a429-8f4209cdc184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:06 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f48cdc4-40b9-466e-a162-fcfb4df37b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:06 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f48cdc4-40b9-466e-a162-fcfb4df37b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1977337974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aff8193-334e-42fc-b989-b8a67bf02ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5733482120ea4cfd955c2419bdf4aa0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:06Z,use_quota=True,user_id='0b47a7c532b24d1e86b44e7dd453c27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:06 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d112c0-66a1-4c7d-b67f-bb53fb40d8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:06 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d112c0-66a1-4c7d-b67f-bb53fb40d8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:06 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4082dfda-3c89-4a54-8e34-1ddacdf459e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:06 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4082dfda-3c89-4a54-8e34-1ddacdf459e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aff8193-334e-42fc-b989-b8a67bf02ee0', 'volume_name': 'volume-3aff8193-334e-42fc-b989-b8a67bf02ee0', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:06 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3413ae0a-06a4-4977-9dfd-c7a9f20f6dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:06 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3413ae0a-06a4-4977-9dfd-c7a9f20f6dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:06 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba8cc15-12c4-48cc-a557-e609716af6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:06 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Volume 3aff8193-334e-42fc-b989-b8a67bf02ee0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aff8193-334e-42fc-b989-b8a67bf02ee0', 'volume_size': 1}
Sep 04 16:08:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1977337974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aff8193-334e-42fc-b989-b8a67bf02ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5733482120ea4cfd955c2419bdf4aa0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:06Z,use_quota=True,user_id='0b47a7c532b24d1e86b44e7dd453c27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:08:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Creating volume 3aff8193-334e-42fc-b989-b8a67bf02ee0 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:08:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:08:06 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:08:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3aff8193-334e-42fc-b989-b8a67bf02ee0 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:06 devstack sudo[107069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3aff8193-334e-42fc-b989-b8a67bf02ee0 1073741824
Sep 04 16:08:06 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Flow 'volume_create_manager' (32cd37a2-45d3-4187-b3a2-8776f01c624e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (229aace8-0c1e-4589-8d3e-8a771da74101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (229aace8-0c1e-4589-8d3e-8a771da74101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1264534375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5733482120ea4cfd955c2419bdf4aa0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:07Z,use_quota=True,user_id='0b47a7c532b24d1e86b44e7dd453c27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6744feaf-e396-48fd-813d-c4a3ce760e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6744feaf-e396-48fd-813d-c4a3ce760e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ab43dd-9152-4f6c-9cb6-284ec16cc1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ab43dd-9152-4f6c-9cb6-284ec16cc1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52', 'volume_name': 'volume-97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98cc260b-5a87-4a24-9055-d75a714e17b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98cc260b-5a87-4a24-9055-d75a714e17b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1a529c-4fe0-42cb-a1ce-80ff22d50a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:07 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Volume 97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52', 'volume_size': 1}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:07 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3aff8193-334e-42fc-b989-b8a67bf02ee0 1073741824" returned: 0 in 0.730s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3aff8193-334e-42fc-b989-b8a67bf02ee0 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:07 devstack sudo[107075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3aff8193-334e-42fc-b989-b8a67bf02ee0
Sep 04 16:08:07 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:08:07 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Flow 'volume_create_manager' (0ae05212-a523-40c0-8d48-7dc7bd213c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42984328-8b58-45a5-9235-fb40502a5115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3aff8193-334e-42fc-b989-b8a67bf02ee0" returned: 0 in 0.546s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.676s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1264534375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5733482120ea4cfd955c2419bdf4aa0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:07Z,use_quota=True,user_id='0b47a7c532b24d1e86b44e7dd453c27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Creating volume 97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:08:07 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1f60f331-39b8-410c-9510-1fa8f5ef7dcc tempest-CinderUnicodeTest-1229689783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:07 devstack sudo[107078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52 1073741824
Sep 04 16:08:07 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42984328-8b58-45a5-9235-fb40502a5115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-678730330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8bcbe8e-f0a8-40ae-9e34-1568071a0e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5733482120ea4cfd955c2419bdf4aa0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:08Z,use_quota=True,user_id='0b47a7c532b24d1e86b44e7dd453c27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f91ba1-e974-40df-9b4c-a9f4965c54de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f91ba1-e974-40df-9b4c-a9f4965c54de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (948afa8a-b2cf-475c-865e-9c6c33f6e053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (948afa8a-b2cf-475c-865e-9c6c33f6e053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8bcbe8e-f0a8-40ae-9e34-1568071a0e54', 'volume_name': 'volume-b8bcbe8e-f0a8-40ae-9e34-1568071a0e54', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a0090b-edeb-4f32-95db-a17668b262b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a0090b-edeb-4f32-95db-a17668b262b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63318cb9-9ab3-4f24-bcf3-05f9d2096082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:08 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Volume b8bcbe8e-f0a8-40ae-9e34-1568071a0e54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8bcbe8e-f0a8-40ae-9e34-1568071a0e54', 'volume_size': 1}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba8cc15-12c4-48cc-a557-e609716af6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aff8193-334e-42fc-b989-b8a67bf02ee0', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6578cbb9-3376-4249-ad42-036b736989a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:08 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Volume volume-3aff8193-334e-42fc-b989-b8a67bf02ee0 (3aff8193-334e-42fc-b989-b8a67bf02ee0): created successfully
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6578cbb9-3376-4249-ad42-036b736989a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Flow 'volume_create_manager' (9433849f-8b91-4888-a429-8f4209cdc184) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:08 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-c7d63b38-3592-4fd4-b4ec-5bc38b63f031 tempest-CreateVolumesFromSnapshotTest-842543388 None] Created volume successfully.
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Flow 'volume_create_manager' (f9bb9802-ec61-442c-9286-ff743c720178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38408a56-4516-4b3a-99f9-aed286e66fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38408a56-4516-4b3a-99f9-aed286e66fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1368454292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83857b90-f26c-405a-a1a3-43303392915a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5733482120ea4cfd955c2419bdf4aa0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:08Z,use_quota=True,user_id='0b47a7c532b24d1e86b44e7dd453c27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9843e1d4-586b-40ce-bd3e-ecd441b158eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9843e1d4-586b-40ce-bd3e-ecd441b158eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a2b672-7d2b-44b4-a66d-65353e7582a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a2b672-7d2b-44b4-a66d-65353e7582a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83857b90-f26c-405a-a1a3-43303392915a', 'volume_name': 'volume-83857b90-f26c-405a-a1a3-43303392915a', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe6a7962-441a-4a11-abd3-27f03ea06a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe6a7962-441a-4a11-abd3-27f03ea06a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0f5117e-e799-4a52-a479-82248d8bc1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:08 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Volume 83857b90-f26c-405a-a1a3-43303392915a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83857b90-f26c-405a-a1a3-43303392915a', 'volume_size': 1}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:08 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52 1073741824" returned: 0 in 0.699s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:08 devstack sudo[107084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52
Sep 04 16:08:08 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Flow 'volume_create_manager' (597a9dba-4564-428b-8b42-adef0a0e8b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33cfa578-14db-4b9e-babd-82b4ef14af92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33cfa578-14db-4b9e-babd-82b4ef14af92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2122038302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ccc181-3dcc-4c2a-af79-f4bace19907c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5733482120ea4cfd955c2419bdf4aa0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:09Z,use_quota=True,user_id='0b47a7c532b24d1e86b44e7dd453c27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe422b9-b9d8-44a3-939a-892878af24cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe422b9-b9d8-44a3-939a-892878af24cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad68211-7254-49b7-9818-ebdb3b2197b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad68211-7254-49b7-9818-ebdb3b2197b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18ccc181-3dcc-4c2a-af79-f4bace19907c', 'volume_name': 'volume-18ccc181-3dcc-4c2a-af79-f4bace19907c', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc75d5e-5548-4326-9359-8f02172577c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc75d5e-5548-4326-9359-8f02172577c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (800067ae-ae2d-4113-9d02-930539f740d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:08 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Volume 18ccc181-3dcc-4c2a-af79-f4bace19907c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18ccc181-3dcc-4c2a-af79-f4bace19907c', 'volume_size': 1}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:08 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52" returned: 0 in 0.328s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1f60f331-39b8-410c-9510-1fa8f5ef7dcc tempest-CinderUnicodeTest-1229689783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.057s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1a529c-4fe0-42cb-a1ce-80ff22d50a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63fafd9-b9a0-483a-bede-776ac4a47da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:09 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-1f60f331-39b8-410c-9510-1fa8f5ef7dcc tempest-CinderUnicodeTest-1229689783 None] Creating offline snapshot c3a3edd4-232e-4d32-b14e-726140c47f8a of volume c13b36f0-49f9-48e2-8e7c-4e9e2684de88 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 16:08:09 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Volume volume-97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52 (97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52): created successfully
Sep 04 16:08:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63fafd9-b9a0-483a-bede-776ac4a47da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:09 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Flow 'volume_create_manager' (32cd37a2-45d3-4187-b3a2-8776f01c624e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:09 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8f4af5-9804-4f9b-8086-602466489b6b]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1f60f331-39b8-410c-9510-1fa8f5ef7dcc tempest-CinderUnicodeTest-1229689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:09 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-294498e2-af0a-4d8b-be17-0093fbaabe04 tempest-CreateVolumesFromSnapshotTest-842543388 None] Created volume successfully.
Sep 04 16:08:09 devstack sudo[107087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88
Sep 04 16:08:09 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:09 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1f60f331-39b8-410c-9510-1fa8f5ef7dcc tempest-CinderUnicodeTest-1229689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88" returned: 0 in 0.477s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1f60f331-39b8-410c-9510-1fa8f5ef7dcc tempest-CinderUnicodeTest-1229689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.c3a3edd4-232e-4d32-b14e-726140c47f8a 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:09 devstack sudo[107126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.c3a3edd4-232e-4d32-b14e-726140c47f8a 1G
Sep 04 16:08:09 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:10 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1f60f331-39b8-410c-9510-1fa8f5ef7dcc tempest-CinderUnicodeTest-1229689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.c3a3edd4-232e-4d32-b14e-726140c47f8a 1G" returned: 0 in 0.697s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1f60f331-39b8-410c-9510-1fa8f5ef7dcc tempest-CinderUnicodeTest-1229689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.c3a3edd4-232e-4d32-b14e-726140c47f8a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:10 devstack sudo[107134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.c3a3edd4-232e-4d32-b14e-726140c47f8a
Sep 04 16:08:10 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:10 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:08:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Flow 'volume_create_manager' (b4848f17-5c4e-4d9b-a8eb-86fe26f2f3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ce83fd-34f4-418d-9532-79b8116ffd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ce83fd-34f4-418d-9532-79b8116ffd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1385904312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a825906-d797-4c80-a700-c62b856b93c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07bb09d5823f43dca188c4caaa4b5480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:10Z,use_quota=True,user_id='0b76e0f6fc0e44b7bec703b6fd64ec59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7550081-9993-463d-9cfa-a325ab0f1e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7550081-9993-463d-9cfa-a325ab0f1e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c492c53b-f2c0-42fa-9654-984a51bb12e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c492c53b-f2c0-42fa-9654-984a51bb12e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a825906-d797-4c80-a700-c62b856b93c5', 'volume_name': 'volume-8a825906-d797-4c80-a700-c62b856b93c5', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ead8792-0240-453c-b135-1514946fe7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ead8792-0240-453c-b135-1514946fe7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:10 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2637181a-e741-440e-9d70-6b707a06a244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:10 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Volume 8a825906-d797-4c80-a700-c62b856b93c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a825906-d797-4c80-a700-c62b856b93c5', 'volume_size': 1}
Sep 04 16:08:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:10 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1f60f331-39b8-410c-9510-1fa8f5ef7dcc tempest-CinderUnicodeTest-1229689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.c3a3edd4-232e-4d32-b14e-726140c47f8a" returned: 0 in 0.358s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:10 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-1f60f331-39b8-410c-9510-1fa8f5ef7dcc tempest-CinderUnicodeTest-1229689783 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.c3a3edd4-232e-4d32-b14e-726140c47f8a is being set with open permissions: ugo+rw
Sep 04 16:08:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1f60f331-39b8-410c-9510-1fa8f5ef7dcc tempest-CinderUnicodeTest-1229689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.c3a3edd4-232e-4d32-b14e-726140c47f8a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:10 devstack sudo[107139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.c3a3edd4-232e-4d32-b14e-726140c47f8a
Sep 04 16:08:10 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:10 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1f60f331-39b8-410c-9510-1fa8f5ef7dcc tempest-CinderUnicodeTest-1229689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.c3a3edd4-232e-4d32-b14e-726140c47f8a" returned: 0 in 0.252s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1f60f331-39b8-410c-9510-1fa8f5ef7dcc tempest-CinderUnicodeTest-1229689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:10 devstack sudo[107142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.info
Sep 04 16:08:10 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:11 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1f60f331-39b8-410c-9510-1fa8f5ef7dcc tempest-CinderUnicodeTest-1229689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.info" returned: 0 in 0.248s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:11 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-1f60f331-39b8-410c-9510-1fa8f5ef7dcc tempest-CinderUnicodeTest-1229689783 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.info is being set with open permissions: ugo+rw
Sep 04 16:08:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1f60f331-39b8-410c-9510-1fa8f5ef7dcc tempest-CinderUnicodeTest-1229689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:11 devstack sudo[107145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.info
Sep 04 16:08:11 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:11 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1f60f331-39b8-410c-9510-1fa8f5ef7dcc tempest-CinderUnicodeTest-1229689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.info" returned: 0 in 0.236s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1f60f331-39b8-410c-9510-1fa8f5ef7dcc tempest-CinderUnicodeTest-1229689783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.399s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.376s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-678730330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8bcbe8e-f0a8-40ae-9e34-1568071a0e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5733482120ea4cfd955c2419bdf4aa0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:08Z,use_quota=True,user_id='0b47a7c532b24d1e86b44e7dd453c27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:08:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Creating volume b8bcbe8e-f0a8-40ae-9e34-1568071a0e54 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:08:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:08:11 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:08:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b8bcbe8e-f0a8-40ae-9e34-1568071a0e54 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:11 devstack sudo[107148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b8bcbe8e-f0a8-40ae-9e34-1568071a0e54 1073741824
Sep 04 16:08:11 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:11 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-1f60f331-39b8-410c-9510-1fa8f5ef7dcc tempest-CinderUnicodeTest-1229689783 None] Create snapshot completed successfully
Sep 04 16:08:11 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b8bcbe8e-f0a8-40ae-9e34-1568071a0e54 1073741824" returned: 0 in 0.424s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b8bcbe8e-f0a8-40ae-9e34-1568071a0e54 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:11 devstack sudo[107154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b8bcbe8e-f0a8-40ae-9e34-1568071a0e54
Sep 04 16:08:11 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:12 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b8bcbe8e-f0a8-40ae-9e34-1568071a0e54" returned: 0 in 0.262s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.700s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1368454292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83857b90-f26c-405a-a1a3-43303392915a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5733482120ea4cfd955c2419bdf4aa0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:08Z,use_quota=True,user_id='0b47a7c532b24d1e86b44e7dd453c27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Creating volume 83857b90-f26c-405a-a1a3-43303392915a {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:08:12 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-83857b90-f26c-405a-a1a3-43303392915a 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63318cb9-9ab3-4f24-bcf3-05f9d2096082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8bcbe8e-f0a8-40ae-9e34-1568071a0e54', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:12 devstack sudo[107157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-83857b90-f26c-405a-a1a3-43303392915a 1073741824
Sep 04 16:08:12 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7348b13a-3da3-4bbf-8ddd-698cc2980f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:12 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Volume volume-b8bcbe8e-f0a8-40ae-9e34-1568071a0e54 (b8bcbe8e-f0a8-40ae-9e34-1568071a0e54): created successfully
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7348b13a-3da3-4bbf-8ddd-698cc2980f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Flow 'volume_create_manager' (0ae05212-a523-40c0-8d48-7dc7bd213c64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:12 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-a811b9a9-91fc-4d0b-8946-471bbe9cf812 tempest-CreateVolumesFromSnapshotTest-842543388 None] Created volume successfully.
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fb9b2e65-f22c-4eac-81eb-3410fafa5b46 tempest-CinderUnicodeTest-1229689783 None] Acquiring lock "cinder-c3a3edd4-232e-4d32-b14e-726140c47f8a-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fb9b2e65-f22c-4eac-81eb-3410fafa5b46 tempest-CinderUnicodeTest-1229689783 None] Lock "cinder-c3a3edd4-232e-4d32-b14e-726140c47f8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fb9b2e65-f22c-4eac-81eb-3410fafa5b46 tempest-CinderUnicodeTest-1229689783 None] Acquiring lock "cinder-quobyte-c13b36f0-49f9-48e2-8e7c-4e9e2684de88" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fb9b2e65-f22c-4eac-81eb-3410fafa5b46 tempest-CinderUnicodeTest-1229689783 None] Lock "cinder-quobyte-c13b36f0-49f9-48e2-8e7c-4e9e2684de88" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fb9b2e65-f22c-4eac-81eb-3410fafa5b46 tempest-CinderUnicodeTest-1229689783 None] Acquiring lock "cinder-quobyte-c3a3edd4-232e-4d32-b14e-726140c47f8a" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fb9b2e65-f22c-4eac-81eb-3410fafa5b46 tempest-CinderUnicodeTest-1229689783 None] Lock "cinder-quobyte-c3a3edd4-232e-4d32-b14e-726140c47f8a" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-fb9b2e65-f22c-4eac-81eb-3410fafa5b46 tempest-CinderUnicodeTest-1229689783 None] Deleting offline snapshot c3a3edd4-232e-4d32-b14e-726140c47f8a of volume c13b36f0-49f9-48e2-8e7c-4e9e2684de88 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-fb9b2e65-f22c-4eac-81eb-3410fafa5b46 tempest-CinderUnicodeTest-1229689783 None] snapshot_file for this snap is: volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.c3a3edd4-232e-4d32-b14e-726140c47f8a {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e19478-ddac-429a-9643-b5c7e63124ce]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb9b2e65-f22c-4eac-81eb-3410fafa5b46 tempest-CinderUnicodeTest-1229689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.c3a3edd4-232e-4d32-b14e-726140c47f8a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:12 devstack sudo[107162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.c3a3edd4-232e-4d32-b14e-726140c47f8a
Sep 04 16:08:12 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:12 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-83857b90-f26c-405a-a1a3-43303392915a 1073741824" returned: 0 in 0.593s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-83857b90-f26c-405a-a1a3-43303392915a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:12 devstack sudo[107166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-83857b90-f26c-405a-a1a3-43303392915a
Sep 04 16:08:12 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:12 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb9b2e65-f22c-4eac-81eb-3410fafa5b46 tempest-CinderUnicodeTest-1229689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.c3a3edd4-232e-4d32-b14e-726140c47f8a" returned: 0 in 0.462s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-fb9b2e65-f22c-4eac-81eb-3410fafa5b46 tempest-CinderUnicodeTest-1229689783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf8c097-9e5d-41eb-b438-4a5f86595eb1]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb9b2e65-f22c-4eac-81eb-3410fafa5b46 tempest-CinderUnicodeTest-1229689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:13 devstack sudo[107171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88
Sep 04 16:08:13 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:13 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-83857b90-f26c-405a-a1a3-43303392915a" returned: 0 in 0.267s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.177s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2122038302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ccc181-3dcc-4c2a-af79-f4bace19907c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5733482120ea4cfd955c2419bdf4aa0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:09Z,use_quota=True,user_id='0b47a7c532b24d1e86b44e7dd453c27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Creating volume 18ccc181-3dcc-4c2a-af79-f4bace19907c {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:08:13 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-18ccc181-3dcc-4c2a-af79-f4bace19907c 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0f5117e-e799-4a52-a479-82248d8bc1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83857b90-f26c-405a-a1a3-43303392915a', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:13 devstack sudo[107174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-18ccc181-3dcc-4c2a-af79-f4bace19907c 1073741824
Sep 04 16:08:13 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec3196e-4520-498f-995b-f3db16351222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:13 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Volume volume-83857b90-f26c-405a-a1a3-43303392915a (83857b90-f26c-405a-a1a3-43303392915a): created successfully
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec3196e-4520-498f-995b-f3db16351222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Flow 'volume_create_manager' (f9bb9802-ec61-442c-9286-ff743c720178) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:13 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-df072066-e5eb-4a87-89b3-17a62bef83be tempest-CreateVolumesFromSnapshotTest-842543388 None] Created volume successfully.
Sep 04 16:08:13 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb9b2e65-f22c-4eac-81eb-3410fafa5b46 tempest-CinderUnicodeTest-1229689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88" returned: 0 in 0.355s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb9b2e65-f22c-4eac-81eb-3410fafa5b46 tempest-CinderUnicodeTest-1229689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.c3a3edd4-232e-4d32-b14e-726140c47f8a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:13 devstack sudo[107181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.c3a3edd4-232e-4d32-b14e-726140c47f8a
Sep 04 16:08:13 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:13 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-18ccc181-3dcc-4c2a-af79-f4bace19907c 1073741824" returned: 0 in 0.459s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-18ccc181-3dcc-4c2a-af79-f4bace19907c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:13 devstack sudo[107188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-18ccc181-3dcc-4c2a-af79-f4bace19907c
Sep 04 16:08:13 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:13 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb9b2e65-f22c-4eac-81eb-3410fafa5b46 tempest-CinderUnicodeTest-1229689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.c3a3edd4-232e-4d32-b14e-726140c47f8a" returned: 0 in 0.395s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb9b2e65-f22c-4eac-81eb-3410fafa5b46 tempest-CinderUnicodeTest-1229689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.c3a3edd4-232e-4d32-b14e-726140c47f8a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:13 devstack sudo[107192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.c3a3edd4-232e-4d32-b14e-726140c47f8a
Sep 04 16:08:13 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:13 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-18ccc181-3dcc-4c2a-af79-f4bace19907c" returned: 0 in 0.323s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.402s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1385904312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a825906-d797-4c80-a700-c62b856b93c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07bb09d5823f43dca188c4caaa4b5480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:10Z,use_quota=True,user_id='0b76e0f6fc0e44b7bec703b6fd64ec59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Creating volume 8a825906-d797-4c80-a700-c62b856b93c5 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:08:13 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (800067ae-ae2d-4113-9d02-930539f740d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18ccc181-3dcc-4c2a-af79-f4bace19907c', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95e66db-9545-49e6-af73-758715b94414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:13 devstack sudo[107196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5 1073741824
Sep 04 16:08:13 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:13 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:13 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Volume volume-18ccc181-3dcc-4c2a-af79-f4bace19907c (18ccc181-3dcc-4c2a-af79-f4bace19907c): created successfully
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95e66db-9545-49e6-af73-758715b94414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Flow 'volume_create_manager' (597a9dba-4564-428b-8b42-adef0a0e8b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb9b2e65-f22c-4eac-81eb-3410fafa5b46 tempest-CinderUnicodeTest-1229689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88.c3a3edd4-232e-4d32-b14e-726140c47f8a" returned: 0 in 0.291s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:13 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-123c50ac-d48c-4dac-b80f-e636f3501f41 tempest-CreateVolumesFromSnapshotTest-842543388 None] Created volume successfully.
Sep 04 16:08:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fb9b2e65-f22c-4eac-81eb-3410fafa5b46 tempest-CinderUnicodeTest-1229689783 None] Lock "cinder-quobyte-c3a3edd4-232e-4d32-b14e-726140c47f8a" released by "_delete_snapshot" :: held 1.645s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fb9b2e65-f22c-4eac-81eb-3410fafa5b46 tempest-CinderUnicodeTest-1229689783 None] Lock "cinder-quobyte-c13b36f0-49f9-48e2-8e7c-4e9e2684de88" released by "delete_snapshot" :: held 1.689s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:14 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-fb9b2e65-f22c-4eac-81eb-3410fafa5b46 tempest-CinderUnicodeTest-1229689783 None] Created reservations ['ab341df5-c1ff-4dd1-bab2-d680df49986a', '594c136c-e520-4389-aa22-705c31603f9e', 'ef360888-3dbb-48ed-944c-5f417332b82c', '5cfea41b-1822-4790-88d0-0c7cda4e7074'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:08:14 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-fb9b2e65-f22c-4eac-81eb-3410fafa5b46 tempest-CinderUnicodeTest-1229689783 None] Delete snapshot completed successfully.
Sep 04 16:08:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-fb9b2e65-f22c-4eac-81eb-3410fafa5b46 tempest-CinderUnicodeTest-1229689783 None] Lock "cinder-c3a3edd4-232e-4d32-b14e-726140c47f8a-delete_snapshot" released by "delete_snapshot" :: held 1.848s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:14 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5 1073741824" returned: 0 in 0.515s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:14 devstack sudo[107202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5
Sep 04 16:08:14 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f2fcb103-2c66-41f3-9076-391a55d68615 tempest-CinderUnicodeTest-1229689783 None] Acquiring lock "cinder-c13b36f0-49f9-48e2-8e7c-4e9e2684de88-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f2fcb103-2c66-41f3-9076-391a55d68615 tempest-CinderUnicodeTest-1229689783 None] Lock "cinder-c13b36f0-49f9-48e2-8e7c-4e9e2684de88-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f2fcb103-2c66-41f3-9076-391a55d68615 tempest-CinderUnicodeTest-1229689783 None] Acquiring lock "cinder-quobyte-c13b36f0-49f9-48e2-8e7c-4e9e2684de88" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f2fcb103-2c66-41f3-9076-391a55d68615 tempest-CinderUnicodeTest-1229689783 None] Lock "cinder-quobyte-c13b36f0-49f9-48e2-8e7c-4e9e2684de88" acquired by "delete_volume" :: waited 0.019s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:14 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b57806-1e57-4222-a2f5-80bffa4331dc]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f2fcb103-2c66-41f3-9076-391a55d68615 tempest-CinderUnicodeTest-1229689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:14 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5" returned: 0 in 0.357s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:14 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:08:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:14 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2637181a-e741-440e-9d70-6b707a06a244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a825906-d797-4c80-a700-c62b856b93c5', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:14 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7860c9d-1759-49d1-b2b5-5055313c29d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:14 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Volume volume-8a825906-d797-4c80-a700-c62b856b93c5 (8a825906-d797-4c80-a700-c62b856b93c5): created successfully
Sep 04 16:08:14 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7860c9d-1759-49d1-b2b5-5055313c29d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:14 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Flow 'volume_create_manager' (b4848f17-5c4e-4d9b-a8eb-86fe26f2f3e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:14 devstack sudo[107206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88
Sep 04 16:08:14 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ed3ddb65-5139-40e8-aaf7-630dd0fa1019 tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "cinder-18ccc181-3dcc-4c2a-af79-f4bace19907c-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:14 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-d7bbc9d8-db47-4c3d-a5b3-625e17c17918 tempest-ProjectReaderTests-1922078704 None] Created volume successfully.
Sep 04 16:08:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ed3ddb65-5139-40e8-aaf7-630dd0fa1019 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-18ccc181-3dcc-4c2a-af79-f4bace19907c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ed3ddb65-5139-40e8-aaf7-630dd0fa1019 tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "cinder-quobyte-18ccc181-3dcc-4c2a-af79-f4bace19907c" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ed3ddb65-5139-40e8-aaf7-630dd0fa1019 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-quobyte-18ccc181-3dcc-4c2a-af79-f4bace19907c" acquired by "delete_volume" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[78458992-0bf4-4890-9263-ed082161a927]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ed3ddb65-5139-40e8-aaf7-630dd0fa1019 tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-18ccc181-3dcc-4c2a-af79-f4bace19907c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:15 devstack sudo[107208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-18ccc181-3dcc-4c2a-af79-f4bace19907c
Sep 04 16:08:15 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:15 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f2fcb103-2c66-41f3-9076-391a55d68615 tempest-CinderUnicodeTest-1229689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88" returned: 0 in 0.406s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f2fcb103-2c66-41f3-9076-391a55d68615 tempest-CinderUnicodeTest-1229689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:15 devstack sudo[107213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88
Sep 04 16:08:15 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:15 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ed3ddb65-5139-40e8-aaf7-630dd0fa1019 tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-18ccc181-3dcc-4c2a-af79-f4bace19907c" returned: 0 in 0.362s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ed3ddb65-5139-40e8-aaf7-630dd0fa1019 tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-18ccc181-3dcc-4c2a-af79-f4bace19907c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:15 devstack sudo[107218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-18ccc181-3dcc-4c2a-af79-f4bace19907c
Sep 04 16:08:15 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:15 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f2fcb103-2c66-41f3-9076-391a55d68615 tempest-CinderUnicodeTest-1229689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c13b36f0-49f9-48e2-8e7c-4e9e2684de88" returned: 0 in 0.273s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f2fcb103-2c66-41f3-9076-391a55d68615 tempest-CinderUnicodeTest-1229689783 None] Lock "cinder-quobyte-c13b36f0-49f9-48e2-8e7c-4e9e2684de88" released by "delete_volume" :: held 0.762s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-f2fcb103-2c66-41f3-9076-391a55d68615 tempest-CinderUnicodeTest-1229689783 None] Created reservations ['ae8745d6-8375-40dd-8cd7-3d2bd2a98d9a', '3ffc04b1-a356-4c2d-a19c-2f75d0f2fc3d', 'e397129f-88c4-40f4-97a6-e73dc4279523', '09bff374-39d1-45cd-a3a8-908c3a15face'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f2fcb103-2c66-41f3-9076-391a55d68615 tempest-CinderUnicodeTest-1229689783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f2fcb103-2c66-41f3-9076-391a55d68615 tempest-CinderUnicodeTest-1229689783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f2fcb103-2c66-41f3-9076-391a55d68615 tempest-CinderUnicodeTest-1229689783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f2fcb103-2c66-41f3-9076-391a55d68615 tempest-CinderUnicodeTest-1229689783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f2fcb103-2c66-41f3-9076-391a55d68615 tempest-CinderUnicodeTest-1229689783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f2fcb103-2c66-41f3-9076-391a55d68615 tempest-CinderUnicodeTest-1229689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:15 devstack sudo[107222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:08:15 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:15 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ed3ddb65-5139-40e8-aaf7-630dd0fa1019 tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-18ccc181-3dcc-4c2a-af79-f4bace19907c" returned: 0 in 0.264s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ed3ddb65-5139-40e8-aaf7-630dd0fa1019 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-quobyte-18ccc181-3dcc-4c2a-af79-f4bace19907c" released by "delete_volume" :: held 0.674s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-ed3ddb65-5139-40e8-aaf7-630dd0fa1019 tempest-CreateVolumesFromSnapshotTest-842543388 None] Created reservations ['09c01a77-5caa-47c4-a1d6-67f56ae16794', 'de8afb07-41ac-4238-9469-98b6633bafbb', 'afe56641-971b-452d-b5d9-c7c5e69f4dbe', 'a0e8f79e-7bce-4988-94b8-c4b494e32c23'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-304c37e6-051c-40a2-9ca0-a692271cfc13 tempest-CinderUnicodeTest-1229689783 None] Acquiring lock "cinder-56d3036a-d568-46a2-ac23-830600363594-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ed3ddb65-5139-40e8-aaf7-630dd0fa1019 tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ed3ddb65-5139-40e8-aaf7-630dd0fa1019 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ed3ddb65-5139-40e8-aaf7-630dd0fa1019 tempest-CreateVolumesFromSnapshotTest-842543388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ed3ddb65-5139-40e8-aaf7-630dd0fa1019 tempest-CreateVolumesFromSnapshotTest-842543388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ed3ddb65-5139-40e8-aaf7-630dd0fa1019 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ed3ddb65-5139-40e8-aaf7-630dd0fa1019 tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-304c37e6-051c-40a2-9ca0-a692271cfc13 tempest-CinderUnicodeTest-1229689783 None] Lock "cinder-56d3036a-d568-46a2-ac23-830600363594-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:15 devstack sudo[107224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:08:15 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:15 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f2fcb103-2c66-41f3-9076-391a55d68615 tempest-CinderUnicodeTest-1229689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.381s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-f2fcb103-2c66-41f3-9076-391a55d68615 tempest-CinderUnicodeTest-1229689783 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:08:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-304c37e6-051c-40a2-9ca0-a692271cfc13 tempest-CinderUnicodeTest-1229689783 None] Acquiring lock "cinder-quobyte-56d3036a-d568-46a2-ac23-830600363594" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:15 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f2fcb103-2c66-41f3-9076-391a55d68615 tempest-CinderUnicodeTest-1229689783 None] Deleted volume successfully.
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-304c37e6-051c-40a2-9ca0-a692271cfc13 tempest-CinderUnicodeTest-1229689783 None] Lock "cinder-quobyte-56d3036a-d568-46a2-ac23-830600363594" acquired by "delete_volume" :: waited 0.028s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f2fcb103-2c66-41f3-9076-391a55d68615 tempest-CinderUnicodeTest-1229689783 None] Lock "cinder-c13b36f0-49f9-48e2-8e7c-4e9e2684de88-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07a409a-91f2-4d04-aada-c9ed1e6a1092]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-304c37e6-051c-40a2-9ca0-a692271cfc13 tempest-CinderUnicodeTest-1229689783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-56d3036a-d568-46a2-ac23-830600363594 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-78d51685-dfcb-44aa-92cf-dff8abc78959 tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "cinder-83857b90-f26c-405a-a1a3-43303392915a-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-78d51685-dfcb-44aa-92cf-dff8abc78959 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-83857b90-f26c-405a-a1a3-43303392915a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-05840d73-ac5b-4188-ba2a-7e0a955492fb tempest-ProjectReaderTests-1922078704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-05840d73-ac5b-4188-ba2a-7e0a955492fb tempest-ProjectReaderTests-1922078704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-05840d73-ac5b-4188-ba2a-7e0a955492fb tempest-ProjectReaderTests-1922078704 None] Creating offline snapshot 1f5366e0-af2f-470e-9704-99e0ea2cea48 of volume 8a825906-d797-4c80-a700-c62b856b93c5 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 16:08:16 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4197d1-c487-4b65-8f97-dc7e8aac67be]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-05840d73-ac5b-4188-ba2a-7e0a955492fb tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ed3ddb65-5139-40e8-aaf7-630dd0fa1019 tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.476s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ed3ddb65-5139-40e8-aaf7-630dd0fa1019 tempest-CreateVolumesFromSnapshotTest-842543388 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:08:16 devstack sudo[107227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-56d3036a-d568-46a2-ac23-830600363594
Sep 04 16:08:16 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-78d51685-dfcb-44aa-92cf-dff8abc78959 tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "cinder-quobyte-83857b90-f26c-405a-a1a3-43303392915a" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:16 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-ed3ddb65-5139-40e8-aaf7-630dd0fa1019 tempest-CreateVolumesFromSnapshotTest-842543388 None] Deleted volume successfully.
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-78d51685-dfcb-44aa-92cf-dff8abc78959 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-quobyte-83857b90-f26c-405a-a1a3-43303392915a" acquired by "delete_volume" :: waited 0.031s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ed3ddb65-5139-40e8-aaf7-630dd0fa1019 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-18ccc181-3dcc-4c2a-af79-f4bace19907c-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[69117074-e696-4502-8939-b7c066a89808]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-78d51685-dfcb-44aa-92cf-dff8abc78959 tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-83857b90-f26c-405a-a1a3-43303392915a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:16 devstack sudo[107229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5
Sep 04 16:08:16 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:16 devstack sudo[107231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-83857b90-f26c-405a-a1a3-43303392915a
Sep 04 16:08:16 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:16 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-304c37e6-051c-40a2-9ca0-a692271cfc13 tempest-CinderUnicodeTest-1229689783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-56d3036a-d568-46a2-ac23-830600363594" returned: 0 in 0.576s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-304c37e6-051c-40a2-9ca0-a692271cfc13 tempest-CinderUnicodeTest-1229689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-56d3036a-d568-46a2-ac23-830600363594 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:16 devstack sudo[107237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-56d3036a-d568-46a2-ac23-830600363594
Sep 04 16:08:16 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:16 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-05840d73-ac5b-4188-ba2a-7e0a955492fb tempest-ProjectReaderTests-1922078704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5" returned: 0 in 0.551s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-05840d73-ac5b-4188-ba2a-7e0a955492fb tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.1f5366e0-af2f-470e-9704-99e0ea2cea48 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:16 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-78d51685-dfcb-44aa-92cf-dff8abc78959 tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-83857b90-f26c-405a-a1a3-43303392915a" returned: 0 in 0.479s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-78d51685-dfcb-44aa-92cf-dff8abc78959 tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-83857b90-f26c-405a-a1a3-43303392915a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:16 devstack sudo[107245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.1f5366e0-af2f-470e-9704-99e0ea2cea48 1G
Sep 04 16:08:16 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:16 devstack sudo[107246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-83857b90-f26c-405a-a1a3-43303392915a
Sep 04 16:08:16 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:16 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-304c37e6-051c-40a2-9ca0-a692271cfc13 tempest-CinderUnicodeTest-1229689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-56d3036a-d568-46a2-ac23-830600363594" returned: 0 in 0.312s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-304c37e6-051c-40a2-9ca0-a692271cfc13 tempest-CinderUnicodeTest-1229689783 None] Lock "cinder-quobyte-56d3036a-d568-46a2-ac23-830600363594" released by "delete_volume" :: held 0.990s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-304c37e6-051c-40a2-9ca0-a692271cfc13 tempest-CinderUnicodeTest-1229689783 None] Created reservations ['5b0b1d28-552c-468c-80a3-4f5e036bb486', '859371b6-ea90-4754-b21f-04a8f86f50aa', 'e9e56994-a9fe-494d-bd92-e9c174ff4b43', 'd4cf4ca7-6c4a-448e-8ad4-0b65fe83fbfa'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:08:17 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-304c37e6-051c-40a2-9ca0-a692271cfc13 tempest-CinderUnicodeTest-1229689783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-304c37e6-051c-40a2-9ca0-a692271cfc13 tempest-CinderUnicodeTest-1229689783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-304c37e6-051c-40a2-9ca0-a692271cfc13 tempest-CinderUnicodeTest-1229689783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-304c37e6-051c-40a2-9ca0-a692271cfc13 tempest-CinderUnicodeTest-1229689783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-304c37e6-051c-40a2-9ca0-a692271cfc13 tempest-CinderUnicodeTest-1229689783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-304c37e6-051c-40a2-9ca0-a692271cfc13 tempest-CinderUnicodeTest-1229689783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-78d51685-dfcb-44aa-92cf-dff8abc78959 tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-83857b90-f26c-405a-a1a3-43303392915a" returned: 0 in 0.352s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-78d51685-dfcb-44aa-92cf-dff8abc78959 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-quobyte-83857b90-f26c-405a-a1a3-43303392915a" released by "delete_volume" :: held 0.904s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:17 devstack sudo[107254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:08:17 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-78d51685-dfcb-44aa-92cf-dff8abc78959 tempest-CreateVolumesFromSnapshotTest-842543388 None] Created reservations ['8a980a3f-934b-4ded-b959-394474288e6d', 'c14dba0a-f277-460b-b36b-eff587b7d4eb', '2d2bebb0-e9ff-4cbe-98ef-c1bdf3acf2d2', 'e0447092-4774-486e-9b60-f7e2636e7f74'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-78d51685-dfcb-44aa-92cf-dff8abc78959 tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-78d51685-dfcb-44aa-92cf-dff8abc78959 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-78d51685-dfcb-44aa-92cf-dff8abc78959 tempest-CreateVolumesFromSnapshotTest-842543388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-78d51685-dfcb-44aa-92cf-dff8abc78959 tempest-CreateVolumesFromSnapshotTest-842543388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-78d51685-dfcb-44aa-92cf-dff8abc78959 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-78d51685-dfcb-44aa-92cf-dff8abc78959 tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:17 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-05840d73-ac5b-4188-ba2a-7e0a955492fb tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.1f5366e0-af2f-470e-9704-99e0ea2cea48 1G" returned: 0 in 0.638s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-05840d73-ac5b-4188-ba2a-7e0a955492fb tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a825906-d797-4c80-a700-c62b856b93c5 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.1f5366e0-af2f-470e-9704-99e0ea2cea48 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:17 devstack sudo[107257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:08:17 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:17 devstack sudo[107258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a825906-d797-4c80-a700-c62b856b93c5 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.1f5366e0-af2f-470e-9704-99e0ea2cea48
Sep 04 16:08:17 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:17 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-304c37e6-051c-40a2-9ca0-a692271cfc13 tempest-CinderUnicodeTest-1229689783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.412s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-304c37e6-051c-40a2-9ca0-a692271cfc13 tempest-CinderUnicodeTest-1229689783 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:08:17 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-304c37e6-051c-40a2-9ca0-a692271cfc13 tempest-CinderUnicodeTest-1229689783 None] Deleted volume successfully.
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-304c37e6-051c-40a2-9ca0-a692271cfc13 tempest-CinderUnicodeTest-1229689783 None] Lock "cinder-56d3036a-d568-46a2-ac23-830600363594-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:17 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-78d51685-dfcb-44aa-92cf-dff8abc78959 tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.323s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-78d51685-dfcb-44aa-92cf-dff8abc78959 tempest-CreateVolumesFromSnapshotTest-842543388 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:08:17 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-78d51685-dfcb-44aa-92cf-dff8abc78959 tempest-CreateVolumesFromSnapshotTest-842543388 None] Deleted volume successfully.
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-78d51685-dfcb-44aa-92cf-dff8abc78959 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-83857b90-f26c-405a-a1a3-43303392915a-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:17 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-05840d73-ac5b-4188-ba2a-7e0a955492fb tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a825906-d797-4c80-a700-c62b856b93c5 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.1f5366e0-af2f-470e-9704-99e0ea2cea48" returned: 0 in 0.355s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:17 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-05840d73-ac5b-4188-ba2a-7e0a955492fb tempest-ProjectReaderTests-1922078704 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.1f5366e0-af2f-470e-9704-99e0ea2cea48 is being set with open permissions: ugo+rw
Sep 04 16:08:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-05840d73-ac5b-4188-ba2a-7e0a955492fb tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.1f5366e0-af2f-470e-9704-99e0ea2cea48 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:17 devstack sudo[107266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.1f5366e0-af2f-470e-9704-99e0ea2cea48
Sep 04 16:08:17 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:18 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-05840d73-ac5b-4188-ba2a-7e0a955492fb tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.1f5366e0-af2f-470e-9704-99e0ea2cea48" returned: 0 in 0.285s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-05840d73-ac5b-4188-ba2a-7e0a955492fb tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:18 devstack sudo[107269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.info
Sep 04 16:08:18 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:18 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-05840d73-ac5b-4188-ba2a-7e0a955492fb tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.info" returned: 0 in 0.314s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:18 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-05840d73-ac5b-4188-ba2a-7e0a955492fb tempest-ProjectReaderTests-1922078704 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.info is being set with open permissions: ugo+rw
Sep 04 16:08:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-05840d73-ac5b-4188-ba2a-7e0a955492fb tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:18 devstack sudo[107272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.info
Sep 04 16:08:18 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:18 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ad481a32-b464-4475-b1e1-d01f517a5f6b tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "cinder-b8bcbe8e-f0a8-40ae-9e34-1568071a0e54-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:18 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ad481a32-b464-4475-b1e1-d01f517a5f6b tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-b8bcbe8e-f0a8-40ae-9e34-1568071a0e54-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:18 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ad481a32-b464-4475-b1e1-d01f517a5f6b tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "cinder-quobyte-b8bcbe8e-f0a8-40ae-9e34-1568071a0e54" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:18 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ad481a32-b464-4475-b1e1-d01f517a5f6b tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-quobyte-b8bcbe8e-f0a8-40ae-9e34-1568071a0e54" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:18 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc029212-b7e4-4569-bc7c-a196ba3f8222]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ad481a32-b464-4475-b1e1-d01f517a5f6b tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b8bcbe8e-f0a8-40ae-9e34-1568071a0e54 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:18 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-05840d73-ac5b-4188-ba2a-7e0a955492fb tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.info" returned: 0 in 0.348s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:18 devstack sudo[107274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b8bcbe8e-f0a8-40ae-9e34-1568071a0e54
Sep 04 16:08:18 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-05840d73-ac5b-4188-ba2a-7e0a955492fb tempest-ProjectReaderTests-1922078704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.622s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:18 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-05840d73-ac5b-4188-ba2a-7e0a955492fb tempest-ProjectReaderTests-1922078704 None] Create snapshot completed successfully
Sep 04 16:08:19 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ad481a32-b464-4475-b1e1-d01f517a5f6b tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b8bcbe8e-f0a8-40ae-9e34-1568071a0e54" returned: 0 in 0.461s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ad481a32-b464-4475-b1e1-d01f517a5f6b tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b8bcbe8e-f0a8-40ae-9e34-1568071a0e54 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:19 devstack sudo[107281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b8bcbe8e-f0a8-40ae-9e34-1568071a0e54
Sep 04 16:08:19 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:19 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ad481a32-b464-4475-b1e1-d01f517a5f6b tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-b8bcbe8e-f0a8-40ae-9e34-1568071a0e54" returned: 0 in 0.289s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ad481a32-b464-4475-b1e1-d01f517a5f6b tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-quobyte-b8bcbe8e-f0a8-40ae-9e34-1568071a0e54" released by "delete_volume" :: held 0.822s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:19 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-ad481a32-b464-4475-b1e1-d01f517a5f6b tempest-CreateVolumesFromSnapshotTest-842543388 None] Created reservations ['bf94452b-064d-4705-a8c4-865e4b3be8a1', 'c5b4d4f4-d36c-45b1-9351-c8599ba66e81', '234ccfcb-c166-42d5-ad44-17c6ee6442bb', '296fdc92-5a75-469d-8589-eab26f51a1a0'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:08:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ad481a32-b464-4475-b1e1-d01f517a5f6b tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ad481a32-b464-4475-b1e1-d01f517a5f6b tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:19 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ad481a32-b464-4475-b1e1-d01f517a5f6b tempest-CreateVolumesFromSnapshotTest-842543388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:19 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ad481a32-b464-4475-b1e1-d01f517a5f6b tempest-CreateVolumesFromSnapshotTest-842543388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ad481a32-b464-4475-b1e1-d01f517a5f6b tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ad481a32-b464-4475-b1e1-d01f517a5f6b tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:19 devstack sudo[107284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:08:19 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9a5716ed-45f0-4472-a92b-78d68040971e tempest-ProjectReaderTests-1922078704 None] Acquiring lock "cinder-1f5366e0-af2f-470e-9704-99e0ea2cea48-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9a5716ed-45f0-4472-a92b-78d68040971e tempest-ProjectReaderTests-1922078704 None] Lock "cinder-1f5366e0-af2f-470e-9704-99e0ea2cea48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9a5716ed-45f0-4472-a92b-78d68040971e tempest-ProjectReaderTests-1922078704 None] Acquiring lock "cinder-quobyte-8a825906-d797-4c80-a700-c62b856b93c5" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9a5716ed-45f0-4472-a92b-78d68040971e tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-8a825906-d797-4c80-a700-c62b856b93c5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9a5716ed-45f0-4472-a92b-78d68040971e tempest-ProjectReaderTests-1922078704 None] Acquiring lock "cinder-quobyte-1f5366e0-af2f-470e-9704-99e0ea2cea48" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9a5716ed-45f0-4472-a92b-78d68040971e tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-1f5366e0-af2f-470e-9704-99e0ea2cea48" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:19 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-9a5716ed-45f0-4472-a92b-78d68040971e tempest-ProjectReaderTests-1922078704 None] Deleting offline snapshot 1f5366e0-af2f-470e-9704-99e0ea2cea48 of volume 8a825906-d797-4c80-a700-c62b856b93c5 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 16:08:19 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-9a5716ed-45f0-4472-a92b-78d68040971e tempest-ProjectReaderTests-1922078704 None] snapshot_file for this snap is: volume-8a825906-d797-4c80-a700-c62b856b93c5.1f5366e0-af2f-470e-9704-99e0ea2cea48 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 16:08:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-cc0f615b-0cd5-4f74-8093-f2d8f8fddd16 tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "cinder-97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:19 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e761c75c-975f-41be-8db4-f6addb47a571]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9a5716ed-45f0-4472-a92b-78d68040971e tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.1f5366e0-af2f-470e-9704-99e0ea2cea48 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-cc0f615b-0cd5-4f74-8093-f2d8f8fddd16 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-cc0f615b-0cd5-4f74-8093-f2d8f8fddd16 tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "cinder-quobyte-97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-cc0f615b-0cd5-4f74-8093-f2d8f8fddd16 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-quobyte-97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52" acquired by "delete_volume" :: waited 0.037s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:20 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ad481a32-b464-4475-b1e1-d01f517a5f6b tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.478s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:20 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ad481a32-b464-4475-b1e1-d01f517a5f6b tempest-CreateVolumesFromSnapshotTest-842543388 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:08:20 devstack sudo[107286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.1f5366e0-af2f-470e-9704-99e0ea2cea48
Sep 04 16:08:20 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:20 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-ad481a32-b464-4475-b1e1-d01f517a5f6b tempest-CreateVolumesFromSnapshotTest-842543388 None] Deleted volume successfully.
Sep 04 16:08:20 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c801dc1f-6712-48cf-a5e1-9e0676bbdc3b]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cc0f615b-0cd5-4f74-8093-f2d8f8fddd16 tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ad481a32-b464-4475-b1e1-d01f517a5f6b tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-b8bcbe8e-f0a8-40ae-9e34-1568071a0e54-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:20 devstack sudo[107295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52
Sep 04 16:08:20 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:20 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9a5716ed-45f0-4472-a92b-78d68040971e tempest-ProjectReaderTests-1922078704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.1f5366e0-af2f-470e-9704-99e0ea2cea48" returned: 0 in 0.500s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-9a5716ed-45f0-4472-a92b-78d68040971e tempest-ProjectReaderTests-1922078704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a825906-d797-4c80-a700-c62b856b93c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:08:20 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe928de-f17f-4220-8b49-1037a33a5cd1]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9a5716ed-45f0-4472-a92b-78d68040971e tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:20 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cc0f615b-0cd5-4f74-8093-f2d8f8fddd16 tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52" returned: 0 in 0.472s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cc0f615b-0cd5-4f74-8093-f2d8f8fddd16 tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:20 devstack sudo[107302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5
Sep 04 16:08:20 devstack sudo[107304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52
Sep 04 16:08:20 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:20 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:20 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cc0f615b-0cd5-4f74-8093-f2d8f8fddd16 tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52" returned: 0 in 0.329s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:20 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-cc0f615b-0cd5-4f74-8093-f2d8f8fddd16 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-quobyte-97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52" released by "delete_volume" :: held 0.882s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9a5716ed-45f0-4472-a92b-78d68040971e tempest-ProjectReaderTests-1922078704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5" returned: 0 in 0.463s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9a5716ed-45f0-4472-a92b-78d68040971e tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.1f5366e0-af2f-470e-9704-99e0ea2cea48 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:21 devstack sudo[107311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.1f5366e0-af2f-470e-9704-99e0ea2cea48
Sep 04 16:08:21 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-cc0f615b-0cd5-4f74-8093-f2d8f8fddd16 tempest-CreateVolumesFromSnapshotTest-842543388 None] Created reservations ['8b45dd1e-db2a-4499-85ea-62c3019fb88d', '59ad4bab-9122-41fc-93c1-215597607a8a', '371be195-8c3d-4f96-bedd-d1b902037934', '81211725-3c60-46bf-aeb7-be0572d78c06'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cc0f615b-0cd5-4f74-8093-f2d8f8fddd16 tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cc0f615b-0cd5-4f74-8093-f2d8f8fddd16 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cc0f615b-0cd5-4f74-8093-f2d8f8fddd16 tempest-CreateVolumesFromSnapshotTest-842543388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-cc0f615b-0cd5-4f74-8093-f2d8f8fddd16 tempest-CreateVolumesFromSnapshotTest-842543388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cc0f615b-0cd5-4f74-8093-f2d8f8fddd16 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cc0f615b-0cd5-4f74-8093-f2d8f8fddd16 tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:21 devstack sudo[107313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:08:21 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:21 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9a5716ed-45f0-4472-a92b-78d68040971e tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.1f5366e0-af2f-470e-9704-99e0ea2cea48" returned: 0 in 0.440s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9a5716ed-45f0-4472-a92b-78d68040971e tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.1f5366e0-af2f-470e-9704-99e0ea2cea48 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:21 devstack sudo[107318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.1f5366e0-af2f-470e-9704-99e0ea2cea48
Sep 04 16:08:21 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:21 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cc0f615b-0cd5-4f74-8093-f2d8f8fddd16 tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.314s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-cc0f615b-0cd5-4f74-8093-f2d8f8fddd16 tempest-CreateVolumesFromSnapshotTest-842543388 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:08:21 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-cc0f615b-0cd5-4f74-8093-f2d8f8fddd16 tempest-CreateVolumesFromSnapshotTest-842543388 None] Deleted volume successfully.
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-cc0f615b-0cd5-4f74-8093-f2d8f8fddd16 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-97fe8dd0-0daa-4bb8-80d0-3b27ed72ea52-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Flow 'volume_create_manager' (7ffa4ffb-baef-4ebe-81ac-bd1f3528203a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fef65b0-6dc3-4524-9ce7-da19c3dd229d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:21 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fef65b0-6dc3-4524-9ce7-da19c3dd229d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1772838580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eafc96c3-2f96-4c7f-a970-2cfc6d51c122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c94454a7a9946518062071ef26a0f2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:22Z,use_quota=True,user_id='03268f6236264965b4832cb83d97aceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c43976-20c9-4ad9-a520-ae44ce103724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c43976-20c9-4ad9-a520-ae44ce103724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c35586f-2d4a-4008-ae11-90b65d194078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c35586f-2d4a-4008-ae11-90b65d194078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eafc96c3-2f96-4c7f-a970-2cfc6d51c122', 'volume_name': 'volume-eafc96c3-2f96-4c7f-a970-2cfc6d51c122', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8b2210-babe-4fc5-a9ab-00b05bd2d20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8b2210-babe-4fc5-a9ab-00b05bd2d20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db69863a-8f30-4015-93b3-b88c2ebcc3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:21 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Volume eafc96c3-2f96-4c7f-a970-2cfc6d51c122: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eafc96c3-2f96-4c7f-a970-2cfc6d51c122', 'volume_size': 1}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1772838580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eafc96c3-2f96-4c7f-a970-2cfc6d51c122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c94454a7a9946518062071ef26a0f2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:22Z,use_quota=True,user_id='03268f6236264965b4832cb83d97aceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Creating volume eafc96c3-2f96-4c7f-a970-2cfc6d51c122 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:08:21 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-eafc96c3-2f96-4c7f-a970-2cfc6d51c122 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9a5716ed-45f0-4472-a92b-78d68040971e tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5.1f5366e0-af2f-470e-9704-99e0ea2cea48" returned: 0 in 0.441s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:21 devstack sudo[107324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-eafc96c3-2f96-4c7f-a970-2cfc6d51c122 1073741824
Sep 04 16:08:21 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9a5716ed-45f0-4472-a92b-78d68040971e tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-1f5366e0-af2f-470e-9704-99e0ea2cea48" released by "_delete_snapshot" :: held 2.056s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9a5716ed-45f0-4472-a92b-78d68040971e tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-8a825906-d797-4c80-a700-c62b856b93c5" released by "delete_snapshot" :: held 2.092s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:21 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-9a5716ed-45f0-4472-a92b-78d68040971e tempest-ProjectReaderTests-1922078704 None] Created reservations ['bd31cb56-02ce-4d28-84d1-80685649fae3', 'e1fbba61-7a79-416c-a4c5-8a2e0a1031f6', '9bf4fb5d-8f11-4dba-a7a9-f7e5b6b6038b', 'd96b11dc-fa4f-48c3-bf08-6364cdacfbc5'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:08:22 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-9a5716ed-45f0-4472-a92b-78d68040971e tempest-ProjectReaderTests-1922078704 None] Delete snapshot completed successfully.
Sep 04 16:08:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9a5716ed-45f0-4472-a92b-78d68040971e tempest-ProjectReaderTests-1922078704 None] Lock "cinder-1f5366e0-af2f-470e-9704-99e0ea2cea48-delete_snapshot" released by "delete_snapshot" :: held 2.272s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7089fdc0-b5df-4001-b4b3-c2d54a787ad4 tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "cinder-3aff8193-334e-42fc-b989-b8a67bf02ee0-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7089fdc0-b5df-4001-b4b3-c2d54a787ad4 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-3aff8193-334e-42fc-b989-b8a67bf02ee0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7089fdc0-b5df-4001-b4b3-c2d54a787ad4 tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "cinder-quobyte-3aff8193-334e-42fc-b989-b8a67bf02ee0" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7089fdc0-b5df-4001-b4b3-c2d54a787ad4 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-quobyte-3aff8193-334e-42fc-b989-b8a67bf02ee0" acquired by "delete_volume" :: waited 0.026s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:22 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-eafc96c3-2f96-4c7f-a970-2cfc6d51c122 1073741824" returned: 0 in 0.503s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:22 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7f9668-d260-48cf-923c-33fae394ff8f]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7089fdc0-b5df-4001-b4b3-c2d54a787ad4 tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3aff8193-334e-42fc-b989-b8a67bf02ee0 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-eafc96c3-2f96-4c7f-a970-2cfc6d51c122 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:22 devstack sudo[107331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-eafc96c3-2f96-4c7f-a970-2cfc6d51c122
Sep 04 16:08:22 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:22 devstack sudo[107330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3aff8193-334e-42fc-b989-b8a67bf02ee0
Sep 04 16:08:22 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:22 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-eafc96c3-2f96-4c7f-a970-2cfc6d51c122" returned: 0 in 0.294s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:22 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:08:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db69863a-8f30-4015-93b3-b88c2ebcc3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eafc96c3-2f96-4c7f-a970-2cfc6d51c122', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c27d8b92-dbcf-4b4f-a220-4391a072ae45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:22 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Volume volume-eafc96c3-2f96-4c7f-a970-2cfc6d51c122 (eafc96c3-2f96-4c7f-a970-2cfc6d51c122): created successfully
Sep 04 16:08:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c27d8b92-dbcf-4b4f-a220-4391a072ae45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:22 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Flow 'volume_create_manager' (7ffa4ffb-baef-4ebe-81ac-bd1f3528203a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:22 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-5fe6628d-708c-4cab-ae45-81cb44dbf97c tempest-ProjectReaderTests-1049900588 None] Created volume successfully.
Sep 04 16:08:22 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7089fdc0-b5df-4001-b4b3-c2d54a787ad4 tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3aff8193-334e-42fc-b989-b8a67bf02ee0" returned: 0 in 0.474s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7089fdc0-b5df-4001-b4b3-c2d54a787ad4 tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3aff8193-334e-42fc-b989-b8a67bf02ee0 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:22 devstack sudo[107338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3aff8193-334e-42fc-b989-b8a67bf02ee0
Sep 04 16:08:22 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ad984154-6f45-47ba-86ea-c05f933a3916 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "cinder-8a825906-d797-4c80-a700-c62b856b93c5-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ad984154-6f45-47ba-86ea-c05f933a3916 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-8a825906-d797-4c80-a700-c62b856b93c5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ad984154-6f45-47ba-86ea-c05f933a3916 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "cinder-quobyte-8a825906-d797-4c80-a700-c62b856b93c5" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ad984154-6f45-47ba-86ea-c05f933a3916 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-8a825906-d797-4c80-a700-c62b856b93c5" acquired by "delete_volume" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[762f3844-6c7c-4904-8e87-7732abe586d4]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ad984154-6f45-47ba-86ea-c05f933a3916 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:23 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7089fdc0-b5df-4001-b4b3-c2d54a787ad4 tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3aff8193-334e-42fc-b989-b8a67bf02ee0" returned: 0 in 0.283s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7089fdc0-b5df-4001-b4b3-c2d54a787ad4 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-quobyte-3aff8193-334e-42fc-b989-b8a67bf02ee0" released by "delete_volume" :: held 0.815s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-7089fdc0-b5df-4001-b4b3-c2d54a787ad4 tempest-CreateVolumesFromSnapshotTest-842543388 None] Created reservations ['bc57ad52-9e93-4b20-abd2-10092ebc2d18', 'fe794ee3-1e80-4fc2-baaa-c3b44059722f', 'a6d1a58c-dbe2-4e94-9d4e-3fcda7975b6a', 'b1144c2e-5466-498a-8329-13c19f4b8ca4'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:08:23 devstack sudo[107341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5
Sep 04 16:08:23 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7089fdc0-b5df-4001-b4b3-c2d54a787ad4 tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7089fdc0-b5df-4001-b4b3-c2d54a787ad4 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7089fdc0-b5df-4001-b4b3-c2d54a787ad4 tempest-CreateVolumesFromSnapshotTest-842543388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7089fdc0-b5df-4001-b4b3-c2d54a787ad4 tempest-CreateVolumesFromSnapshotTest-842543388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7089fdc0-b5df-4001-b4b3-c2d54a787ad4 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7089fdc0-b5df-4001-b4b3-c2d54a787ad4 tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:23 devstack sudo[107343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:08:23 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-81ccab55-fada-434b-8271-b9f3d03e57ec tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "cinder-05d43b92-6e88-4a51-831d-6f25433d9de5-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-81ccab55-fada-434b-8271-b9f3d03e57ec tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-05d43b92-6e88-4a51-831d-6f25433d9de5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-81ccab55-fada-434b-8271-b9f3d03e57ec tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "cinder-quobyte-6687469a-08df-44a9-ae9f-e6c60d15a9bf" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-81ccab55-fada-434b-8271-b9f3d03e57ec tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-quobyte-6687469a-08df-44a9-ae9f-e6c60d15a9bf" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-81ccab55-fada-434b-8271-b9f3d03e57ec tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "cinder-quobyte-05d43b92-6e88-4a51-831d-6f25433d9de5" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-81ccab55-fada-434b-8271-b9f3d03e57ec tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-quobyte-05d43b92-6e88-4a51-831d-6f25433d9de5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-81ccab55-fada-434b-8271-b9f3d03e57ec tempest-CreateVolumesFromSnapshotTest-842543388 None] Deleting offline snapshot 05d43b92-6e88-4a51-831d-6f25433d9de5 of volume 6687469a-08df-44a9-ae9f-e6c60d15a9bf {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-81ccab55-fada-434b-8271-b9f3d03e57ec tempest-CreateVolumesFromSnapshotTest-842543388 None] snapshot_file for this snap is: volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.05d43b92-6e88-4a51-831d-6f25433d9de5 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebea2958-9d5b-4b0e-b27f-ec6073923bca]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81ccab55-fada-434b-8271-b9f3d03e57ec tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.05d43b92-6e88-4a51-831d-6f25433d9de5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:23 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7089fdc0-b5df-4001-b4b3-c2d54a787ad4 tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.289s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:23 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-7089fdc0-b5df-4001-b4b3-c2d54a787ad4 tempest-CreateVolumesFromSnapshotTest-842543388 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ad984154-6f45-47ba-86ea-c05f933a3916 tempest-ProjectReaderTests-1922078704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5" returned: 0 in 0.452s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ad984154-6f45-47ba-86ea-c05f933a3916 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:23 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-7089fdc0-b5df-4001-b4b3-c2d54a787ad4 tempest-CreateVolumesFromSnapshotTest-842543388 None] Deleted volume successfully.
Sep 04 16:08:23 devstack sudo[107350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5
Sep 04 16:08:23 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-7089fdc0-b5df-4001-b4b3-c2d54a787ad4 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-3aff8193-334e-42fc-b989-b8a67bf02ee0-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:23 devstack sudo[107349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.05d43b92-6e88-4a51-831d-6f25433d9de5
Sep 04 16:08:23 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:23 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ad984154-6f45-47ba-86ea-c05f933a3916 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-8a825906-d797-4c80-a700-c62b856b93c5" returned: 0 in 0.274s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ad984154-6f45-47ba-86ea-c05f933a3916 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-8a825906-d797-4c80-a700-c62b856b93c5" released by "delete_volume" :: held 0.786s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:23 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81ccab55-fada-434b-8271-b9f3d03e57ec tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.05d43b92-6e88-4a51-831d-6f25433d9de5" returned: 0 in 0.378s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:24 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-81ccab55-fada-434b-8271-b9f3d03e57ec tempest-CreateVolumesFromSnapshotTest-842543388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:08:24 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-ad984154-6f45-47ba-86ea-c05f933a3916 tempest-ProjectReaderTests-1922078704 None] Created reservations ['8e2f016b-44a8-4076-909f-3b18e355c97e', 'bfce701c-5229-428d-89dc-3954711862d6', '08f38248-8044-48bc-be1f-c0d9a11347b5', 'b53c0286-fdda-40ec-8959-c1642aabd8e8'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:08:24 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed6c9aa-494d-47a4-869d-1ebd431e812f]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81ccab55-fada-434b-8271-b9f3d03e57ec tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f40e8a08-953f-49f4-897a-6fe6a3e3b961 tempest-ProjectReaderTests-1049900588 None] Acquiring lock "cinder-eafc96c3-2f96-4c7f-a970-2cfc6d51c122-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f40e8a08-953f-49f4-897a-6fe6a3e3b961 tempest-ProjectReaderTests-1049900588 None] Lock "cinder-eafc96c3-2f96-4c7f-a970-2cfc6d51c122-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:24 devstack sudo[107359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf
Sep 04 16:08:24 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ad984154-6f45-47ba-86ea-c05f933a3916 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ad984154-6f45-47ba-86ea-c05f933a3916 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:24 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ad984154-6f45-47ba-86ea-c05f933a3916 tempest-ProjectReaderTests-1922078704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:24 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ad984154-6f45-47ba-86ea-c05f933a3916 tempest-ProjectReaderTests-1922078704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ad984154-6f45-47ba-86ea-c05f933a3916 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ad984154-6f45-47ba-86ea-c05f933a3916 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:24 devstack sudo[107362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:08:24 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f40e8a08-953f-49f4-897a-6fe6a3e3b961 tempest-ProjectReaderTests-1049900588 None] Acquiring lock "cinder-quobyte-eafc96c3-2f96-4c7f-a970-2cfc6d51c122" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f40e8a08-953f-49f4-897a-6fe6a3e3b961 tempest-ProjectReaderTests-1049900588 None] Lock "cinder-quobyte-eafc96c3-2f96-4c7f-a970-2cfc6d51c122" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:24 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8f764a-30a8-41cd-8521-f592648cf666]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f40e8a08-953f-49f4-897a-6fe6a3e3b961 tempest-ProjectReaderTests-1049900588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-eafc96c3-2f96-4c7f-a970-2cfc6d51c122 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:24 devstack sudo[107364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-eafc96c3-2f96-4c7f-a970-2cfc6d51c122
Sep 04 16:08:24 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:24 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ad984154-6f45-47ba-86ea-c05f933a3916 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.386s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:24 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ad984154-6f45-47ba-86ea-c05f933a3916 tempest-ProjectReaderTests-1922078704 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:08:24 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-ad984154-6f45-47ba-86ea-c05f933a3916 tempest-ProjectReaderTests-1922078704 None] Deleted volume successfully.
Sep 04 16:08:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ad984154-6f45-47ba-86ea-c05f933a3916 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-8a825906-d797-4c80-a700-c62b856b93c5-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:24 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81ccab55-fada-434b-8271-b9f3d03e57ec tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf" returned: 0 in 0.723s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81ccab55-fada-434b-8271-b9f3d03e57ec tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.05d43b92-6e88-4a51-831d-6f25433d9de5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:24 devstack sudo[107371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.05d43b92-6e88-4a51-831d-6f25433d9de5
Sep 04 16:08:24 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:24 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f40e8a08-953f-49f4-897a-6fe6a3e3b961 tempest-ProjectReaderTests-1049900588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-eafc96c3-2f96-4c7f-a970-2cfc6d51c122" returned: 0 in 0.624s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f40e8a08-953f-49f4-897a-6fe6a3e3b961 tempest-ProjectReaderTests-1049900588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-eafc96c3-2f96-4c7f-a970-2cfc6d51c122 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:25 devstack sudo[107376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-eafc96c3-2f96-4c7f-a970-2cfc6d51c122
Sep 04 16:08:25 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Flow 'volume_create_manager' (c20d9821-f80c-41c1-9078-30c23b629a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (424356b9-dc3e-4bb4-9d91-22a70a1ceca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (424356b9-dc3e-4bb4-9d91-22a70a1ceca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-620779277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf3791e5-8418-456e-8b9d-3adb0e086159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07bb09d5823f43dca188c4caaa4b5480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:25Z,use_quota=True,user_id='0b76e0f6fc0e44b7bec703b6fd64ec59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da486587-640c-4d8f-9cb5-3594684c56db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da486587-640c-4d8f-9cb5-3594684c56db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac124d5f-0d20-4b46-9a33-34d5628e02ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac124d5f-0d20-4b46-9a33-34d5628e02ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf3791e5-8418-456e-8b9d-3adb0e086159', 'volume_name': 'volume-cf3791e5-8418-456e-8b9d-3adb0e086159', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04199c7b-3c5f-40d4-a60e-a79717a899b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04199c7b-3c5f-40d4-a60e-a79717a899b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd636cd-cec1-4daf-b0e1-7e651e292d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:25 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Volume cf3791e5-8418-456e-8b9d-3adb0e086159: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf3791e5-8418-456e-8b9d-3adb0e086159', 'volume_size': 1}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-620779277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf3791e5-8418-456e-8b9d-3adb0e086159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07bb09d5823f43dca188c4caaa4b5480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:25Z,use_quota=True,user_id='0b76e0f6fc0e44b7bec703b6fd64ec59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Creating volume cf3791e5-8418-456e-8b9d-3adb0e086159 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:08:25 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:25 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81ccab55-fada-434b-8271-b9f3d03e57ec tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.05d43b92-6e88-4a51-831d-6f25433d9de5" returned: 0 in 0.502s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81ccab55-fada-434b-8271-b9f3d03e57ec tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.05d43b92-6e88-4a51-831d-6f25433d9de5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:25 devstack sudo[107381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159 1073741824
Sep 04 16:08:25 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:25 devstack sudo[107382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.05d43b92-6e88-4a51-831d-6f25433d9de5
Sep 04 16:08:25 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:25 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f40e8a08-953f-49f4-897a-6fe6a3e3b961 tempest-ProjectReaderTests-1049900588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-eafc96c3-2f96-4c7f-a970-2cfc6d51c122" returned: 0 in 0.362s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f40e8a08-953f-49f4-897a-6fe6a3e3b961 tempest-ProjectReaderTests-1049900588 None] Lock "cinder-quobyte-eafc96c3-2f96-4c7f-a970-2cfc6d51c122" released by "delete_volume" :: held 1.068s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-f40e8a08-953f-49f4-897a-6fe6a3e3b961 tempest-ProjectReaderTests-1049900588 None] Created reservations ['5d4303d7-a128-48c1-9198-72dab525c497', 'dbc4c422-a35e-42bd-967c-a5d2b8ef9ac9', '23b0e177-95d8-4a1f-9f75-1d9b212a5c12', '32f128fa-d0f9-479a-b84e-89714380fb94'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f40e8a08-953f-49f4-897a-6fe6a3e3b961 tempest-ProjectReaderTests-1049900588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f40e8a08-953f-49f4-897a-6fe6a3e3b961 tempest-ProjectReaderTests-1049900588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f40e8a08-953f-49f4-897a-6fe6a3e3b961 tempest-ProjectReaderTests-1049900588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f40e8a08-953f-49f4-897a-6fe6a3e3b961 tempest-ProjectReaderTests-1049900588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f40e8a08-953f-49f4-897a-6fe6a3e3b961 tempest-ProjectReaderTests-1049900588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f40e8a08-953f-49f4-897a-6fe6a3e3b961 tempest-ProjectReaderTests-1049900588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:25 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81ccab55-fada-434b-8271-b9f3d03e57ec tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf.05d43b92-6e88-4a51-831d-6f25433d9de5" returned: 0 in 0.379s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:25 devstack sudo[107390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:08:25 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-81ccab55-fada-434b-8271-b9f3d03e57ec tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-quobyte-05d43b92-6e88-4a51-831d-6f25433d9de5" released by "_delete_snapshot" :: held 2.151s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-81ccab55-fada-434b-8271-b9f3d03e57ec tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-quobyte-6687469a-08df-44a9-ae9f-e6c60d15a9bf" released by "delete_snapshot" :: held 2.178s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-81ccab55-fada-434b-8271-b9f3d03e57ec tempest-CreateVolumesFromSnapshotTest-842543388 None] Created reservations ['8b5e2ae8-c777-4805-91cb-1790a70ae137', '33396671-7a41-4371-b030-1fafaca5accb', 'd1f54e62-e595-4982-bdf0-957f146eb01f', '08a52057-844d-4d21-b2df-222923c48ffa'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:08:25 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-81ccab55-fada-434b-8271-b9f3d03e57ec tempest-CreateVolumesFromSnapshotTest-842543388 None] Delete snapshot completed successfully.
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-81ccab55-fada-434b-8271-b9f3d03e57ec tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-05d43b92-6e88-4a51-831d-6f25433d9de5-delete_snapshot" released by "delete_snapshot" :: held 2.361s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:25 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159 1073741824" returned: 0 in 0.636s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:25 devstack sudo[107394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159
Sep 04 16:08:25 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:25 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f40e8a08-953f-49f4-897a-6fe6a3e3b961 tempest-ProjectReaderTests-1049900588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.338s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-f40e8a08-953f-49f4-897a-6fe6a3e3b961 tempest-ProjectReaderTests-1049900588 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:08:25 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f40e8a08-953f-49f4-897a-6fe6a3e3b961 tempest-ProjectReaderTests-1049900588 None] Deleted volume successfully.
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-90e74844-e6f7-462b-8258-80090f389c28 tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "cinder-6687469a-08df-44a9-ae9f-e6c60d15a9bf-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f40e8a08-953f-49f4-897a-6fe6a3e3b961 tempest-ProjectReaderTests-1049900588 None] Lock "cinder-eafc96c3-2f96-4c7f-a970-2cfc6d51c122-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:25 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-90e74844-e6f7-462b-8258-80090f389c28 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-6687469a-08df-44a9-ae9f-e6c60d15a9bf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:26 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-90e74844-e6f7-462b-8258-80090f389c28 tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "cinder-quobyte-6687469a-08df-44a9-ae9f-e6c60d15a9bf" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:26 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-90e74844-e6f7-462b-8258-80090f389c28 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-quobyte-6687469a-08df-44a9-ae9f-e6c60d15a9bf" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:26 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f5b3c6-5345-45f0-83bf-8a11d1d224a1]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-90e74844-e6f7-462b-8258-80090f389c28 tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:26 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159" returned: 0 in 0.302s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:08:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd636cd-cec1-4daf-b0e1-7e651e292d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf3791e5-8418-456e-8b9d-3adb0e086159', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff62d599-24f9-45d5-ac8a-4d0aad2e8285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:26 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Volume volume-cf3791e5-8418-456e-8b9d-3adb0e086159 (cf3791e5-8418-456e-8b9d-3adb0e086159): created successfully
Sep 04 16:08:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff62d599-24f9-45d5-ac8a-4d0aad2e8285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Flow 'volume_create_manager' (c20d9821-f80c-41c1-9078-30c23b629a48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:26 devstack sudo[107396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf
Sep 04 16:08:26 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:26 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-dc8d6f40-185c-46df-8add-26e481be6e72 tempest-ProjectReaderTests-1922078704 None] Created volume successfully.
Sep 04 16:08:26 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-90e74844-e6f7-462b-8258-80090f389c28 tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf" returned: 0 in 0.376s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-90e74844-e6f7-462b-8258-80090f389c28 tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:26 devstack sudo[107403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf
Sep 04 16:08:26 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:26 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-90e74844-e6f7-462b-8258-80090f389c28 tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-6687469a-08df-44a9-ae9f-e6c60d15a9bf" returned: 0 in 0.271s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:26 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-90e74844-e6f7-462b-8258-80090f389c28 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-quobyte-6687469a-08df-44a9-ae9f-e6c60d15a9bf" released by "delete_volume" :: held 0.713s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:26 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-90e74844-e6f7-462b-8258-80090f389c28 tempest-CreateVolumesFromSnapshotTest-842543388 None] Created reservations ['97bd06ec-6a9e-4ddc-8a4b-56b3e06c70e9', 'a69f944e-345a-438a-9b99-110d58b897b8', 'ed76274e-4ea2-4f8c-8fd8-6b330f8f6aae', '888fb64b-eb8e-46cc-80c3-0193de8f60af'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:08:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-90e74844-e6f7-462b-8258-80090f389c28 tempest-CreateVolumesFromSnapshotTest-842543388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-90e74844-e6f7-462b-8258-80090f389c28 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-90e74844-e6f7-462b-8258-80090f389c28 tempest-CreateVolumesFromSnapshotTest-842543388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:26 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-90e74844-e6f7-462b-8258-80090f389c28 tempest-CreateVolumesFromSnapshotTest-842543388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-90e74844-e6f7-462b-8258-80090f389c28 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:26 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-90e74844-e6f7-462b-8258-80090f389c28 tempest-CreateVolumesFromSnapshotTest-842543388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:26 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:08:26 devstack sudo[107406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:08:26 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Flow 'volume_create_manager' (4011217f-da11-4e4f-8754-7f072e388f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:26 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7cc581-b6a8-4fcd-a3b8-554f30b2d939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7cc581-b6a8-4fcd-a3b8-554f30b2d939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-245047411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a600fd-06b4-4135-9460-70afc8d9fdd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c94454a7a9946518062071ef26a0f2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:27Z,use_quota=True,user_id='03268f6236264965b4832cb83d97aceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb70296-2168-4eae-894e-484453f5e0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb70296-2168-4eae-894e-484453f5e0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e35d6bd-1a98-4c76-80d4-30ab29713dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e35d6bd-1a98-4c76-80d4-30ab29713dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93a600fd-06b4-4135-9460-70afc8d9fdd5', 'volume_name': 'volume-93a600fd-06b4-4135-9460-70afc8d9fdd5', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b79a2d-b72e-440a-b2f0-76233e57b8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b79a2d-b72e-440a-b2f0-76233e57b8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b94153b-bf8c-4992-88aa-e7c2ce311385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:27 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Volume 93a600fd-06b4-4135-9460-70afc8d9fdd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93a600fd-06b4-4135-9460-70afc8d9fdd5', 'volume_size': 1}
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-245047411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a600fd-06b4-4135-9460-70afc8d9fdd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c94454a7a9946518062071ef26a0f2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:27Z,use_quota=True,user_id='03268f6236264965b4832cb83d97aceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Creating volume 93a600fd-06b4-4135-9460-70afc8d9fdd5 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:08:27 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-93a600fd-06b4-4135-9460-70afc8d9fdd5 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:27 devstack sudo[107408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-93a600fd-06b4-4135-9460-70afc8d9fdd5 1073741824
Sep 04 16:08:27 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:27 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-90e74844-e6f7-462b-8258-80090f389c28 tempest-CreateVolumesFromSnapshotTest-842543388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.415s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-90e74844-e6f7-462b-8258-80090f389c28 tempest-CreateVolumesFromSnapshotTest-842543388 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:08:27 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-90e74844-e6f7-462b-8258-80090f389c28 tempest-CreateVolumesFromSnapshotTest-842543388 None] Deleted volume successfully.
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-90e74844-e6f7-462b-8258-80090f389c28 tempest-CreateVolumesFromSnapshotTest-842543388 None] Lock "cinder-6687469a-08df-44a9-ae9f-e6c60d15a9bf-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b96e9126-90a0-4869-8b27-c9138fb0f32b tempest-ProjectReaderTests-1922078704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:27 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-93a600fd-06b4-4135-9460-70afc8d9fdd5 1073741824" returned: 0 in 0.593s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-93a600fd-06b4-4135-9460-70afc8d9fdd5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:27 devstack sudo[107415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-93a600fd-06b4-4135-9460-70afc8d9fdd5
Sep 04 16:08:27 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:27 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-93a600fd-06b4-4135-9460-70afc8d9fdd5" returned: 0 in 0.254s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b96e9126-90a0-4869-8b27-c9138fb0f32b tempest-ProjectReaderTests-1922078704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.485s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b94153b-bf8c-4992-88aa-e7c2ce311385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93a600fd-06b4-4135-9460-70afc8d9fdd5', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039e668e-264b-48a6-bd6b-1b50b8952565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:28 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-b96e9126-90a0-4869-8b27-c9138fb0f32b tempest-ProjectReaderTests-1922078704 None] Creating offline snapshot 3d16a0c3-297e-4f2c-bd1d-6ac380f2f120 of volume cf3791e5-8418-456e-8b9d-3adb0e086159 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 16:08:28 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Volume volume-93a600fd-06b4-4135-9460-70afc8d9fdd5 (93a600fd-06b4-4135-9460-70afc8d9fdd5): created successfully
Sep 04 16:08:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039e668e-264b-48a6-bd6b-1b50b8952565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:28 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Flow 'volume_create_manager' (4011217f-da11-4e4f-8754-7f072e388f31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:28 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b2d80f-cbb2-4829-9d93-aa3fc8ac9ccc]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b96e9126-90a0-4869-8b27-c9138fb0f32b tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:28 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-0756b14c-2de6-4483-bce4-e8e493d2ef4e tempest-ProjectReaderTests-1049900588 None] Created volume successfully.
Sep 04 16:08:28 devstack sudo[107418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159
Sep 04 16:08:28 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:28 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b96e9126-90a0-4869-8b27-c9138fb0f32b tempest-ProjectReaderTests-1922078704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159" returned: 0 in 0.463s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b96e9126-90a0-4869-8b27-c9138fb0f32b tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.3d16a0c3-297e-4f2c-bd1d-6ac380f2f120 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:28 devstack sudo[107424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.3d16a0c3-297e-4f2c-bd1d-6ac380f2f120 1G
Sep 04 16:08:28 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:29 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8ca73973-9fca-4616-9d09-b031d4bf66c1 tempest-ProjectReaderTests-1049900588 None] Acquiring lock "cinder-93a600fd-06b4-4135-9460-70afc8d9fdd5-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:29 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8ca73973-9fca-4616-9d09-b031d4bf66c1 tempest-ProjectReaderTests-1049900588 None] Lock "cinder-93a600fd-06b4-4135-9460-70afc8d9fdd5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:29 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b96e9126-90a0-4869-8b27-c9138fb0f32b tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.3d16a0c3-297e-4f2c-bd1d-6ac380f2f120 1G" returned: 0 in 0.588s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b96e9126-90a0-4869-8b27-c9138fb0f32b tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf3791e5-8418-456e-8b9d-3adb0e086159 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.3d16a0c3-297e-4f2c-bd1d-6ac380f2f120 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:29 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8ca73973-9fca-4616-9d09-b031d4bf66c1 tempest-ProjectReaderTests-1049900588 None] Acquiring lock "cinder-quobyte-93a600fd-06b4-4135-9460-70afc8d9fdd5" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:29 devstack sudo[107430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf3791e5-8418-456e-8b9d-3adb0e086159 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.3d16a0c3-297e-4f2c-bd1d-6ac380f2f120
Sep 04 16:08:29 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:29 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8ca73973-9fca-4616-9d09-b031d4bf66c1 tempest-ProjectReaderTests-1049900588 None] Lock "cinder-quobyte-93a600fd-06b4-4135-9460-70afc8d9fdd5" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:29 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7a9e12-6e1b-4fd3-951b-dbdc046d4e8d]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8ca73973-9fca-4616-9d09-b031d4bf66c1 tempest-ProjectReaderTests-1049900588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-93a600fd-06b4-4135-9460-70afc8d9fdd5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:29 devstack sudo[107432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-93a600fd-06b4-4135-9460-70afc8d9fdd5
Sep 04 16:08:29 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:29 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b96e9126-90a0-4869-8b27-c9138fb0f32b tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf3791e5-8418-456e-8b9d-3adb0e086159 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.3d16a0c3-297e-4f2c-bd1d-6ac380f2f120" returned: 0 in 0.439s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:29 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-b96e9126-90a0-4869-8b27-c9138fb0f32b tempest-ProjectReaderTests-1922078704 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.3d16a0c3-297e-4f2c-bd1d-6ac380f2f120 is being set with open permissions: ugo+rw
Sep 04 16:08:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b96e9126-90a0-4869-8b27-c9138fb0f32b tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.3d16a0c3-297e-4f2c-bd1d-6ac380f2f120 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:29 devstack sudo[107437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.3d16a0c3-297e-4f2c-bd1d-6ac380f2f120
Sep 04 16:08:29 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:29 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8ca73973-9fca-4616-9d09-b031d4bf66c1 tempest-ProjectReaderTests-1049900588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-93a600fd-06b4-4135-9460-70afc8d9fdd5" returned: 0 in 0.498s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8ca73973-9fca-4616-9d09-b031d4bf66c1 tempest-ProjectReaderTests-1049900588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-93a600fd-06b4-4135-9460-70afc8d9fdd5 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:29 devstack sudo[107443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-93a600fd-06b4-4135-9460-70afc8d9fdd5
Sep 04 16:08:29 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:29 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b96e9126-90a0-4869-8b27-c9138fb0f32b tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.3d16a0c3-297e-4f2c-bd1d-6ac380f2f120" returned: 0 in 0.319s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b96e9126-90a0-4869-8b27-c9138fb0f32b tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:29 devstack sudo[107446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.info
Sep 04 16:08:29 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:30 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8ca73973-9fca-4616-9d09-b031d4bf66c1 tempest-ProjectReaderTests-1049900588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-93a600fd-06b4-4135-9460-70afc8d9fdd5" returned: 0 in 0.302s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:30 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8ca73973-9fca-4616-9d09-b031d4bf66c1 tempest-ProjectReaderTests-1049900588 None] Lock "cinder-quobyte-93a600fd-06b4-4135-9460-70afc8d9fdd5" released by "delete_volume" :: held 0.887s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:30 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-8ca73973-9fca-4616-9d09-b031d4bf66c1 tempest-ProjectReaderTests-1049900588 None] Created reservations ['d91008f3-690b-45ff-94be-fc14491c7294', 'e7ae7c1f-2dbb-400c-85e5-d13699855922', 'e3c11363-a5d9-4d6e-bc87-e02bc962535f', '139a82e5-cdfd-4746-932c-ed382b066eb2'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:08:30 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b96e9126-90a0-4869-8b27-c9138fb0f32b tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.info" returned: 0 in 0.340s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:30 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-b96e9126-90a0-4869-8b27-c9138fb0f32b tempest-ProjectReaderTests-1922078704 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.info is being set with open permissions: ugo+rw
Sep 04 16:08:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b96e9126-90a0-4869-8b27-c9138fb0f32b tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:30 devstack sudo[107450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.info
Sep 04 16:08:30 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-8ca73973-9fca-4616-9d09-b031d4bf66c1 tempest-ProjectReaderTests-1049900588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-8ca73973-9fca-4616-9d09-b031d4bf66c1 tempest-ProjectReaderTests-1049900588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:30 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-8ca73973-9fca-4616-9d09-b031d4bf66c1 tempest-ProjectReaderTests-1049900588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:30 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-8ca73973-9fca-4616-9d09-b031d4bf66c1 tempest-ProjectReaderTests-1049900588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-8ca73973-9fca-4616-9d09-b031d4bf66c1 tempest-ProjectReaderTests-1049900588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8ca73973-9fca-4616-9d09-b031d4bf66c1 tempest-ProjectReaderTests-1049900588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:30 devstack sudo[107452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:08:30 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:30 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8ca73973-9fca-4616-9d09-b031d4bf66c1 tempest-ProjectReaderTests-1049900588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.326s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:30 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-8ca73973-9fca-4616-9d09-b031d4bf66c1 tempest-ProjectReaderTests-1049900588 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:08:30 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-8ca73973-9fca-4616-9d09-b031d4bf66c1 tempest-ProjectReaderTests-1049900588 None] Deleted volume successfully.
Sep 04 16:08:30 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8ca73973-9fca-4616-9d09-b031d4bf66c1 tempest-ProjectReaderTests-1049900588 None] Lock "cinder-93a600fd-06b4-4135-9460-70afc8d9fdd5-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:30 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b96e9126-90a0-4869-8b27-c9138fb0f32b tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.info" returned: 0 in 0.464s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b96e9126-90a0-4869-8b27-c9138fb0f32b tempest-ProjectReaderTests-1922078704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.816s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:30 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-b96e9126-90a0-4869-8b27-c9138fb0f32b tempest-ProjectReaderTests-1922078704 None] Create snapshot completed successfully
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Flow 'volume_create_manager' (1dd15d14-63ce-44f9-8865-e828823220f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f552c502-4beb-4527-803d-7130518e136b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f552c502-4beb-4527-803d-7130518e136b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1765400205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=829a5415-9c4b-473b-bed6-70743841a143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d5ff198ced54135a5a8f0ea5d270503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:31Z,use_quota=True,user_id='45137da81e2d4837917bc342603a4959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de24340-79df-4d0e-a017-76715716b842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de24340-79df-4d0e-a017-76715716b842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd2a92fc-214b-40ee-a382-b02ffddfe376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd2a92fc-214b-40ee-a382-b02ffddfe376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '829a5415-9c4b-473b-bed6-70743841a143', 'volume_name': 'volume-829a5415-9c4b-473b-bed6-70743841a143', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16aed47a-ae61-4f6c-a756-b10504bd22b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16aed47a-ae61-4f6c-a756-b10504bd22b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa51bc5-9000-49b5-adc3-28a13df1731b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:31 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Volume 829a5415-9c4b-473b-bed6-70743841a143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-829a5415-9c4b-473b-bed6-70743841a143', 'volume_size': 1}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1765400205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=829a5415-9c4b-473b-bed6-70743841a143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d5ff198ced54135a5a8f0ea5d270503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:31Z,use_quota=True,user_id='45137da81e2d4837917bc342603a4959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Creating volume 829a5415-9c4b-473b-bed6-70743841a143 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:08:31 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:31 devstack sudo[107456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143 1073741824
Sep 04 16:08:31 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2c6f1d4c-0d32-4f80-ae8f-64f8fa7eb7e6 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "cinder-3d16a0c3-297e-4f2c-bd1d-6ac380f2f120-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2c6f1d4c-0d32-4f80-ae8f-64f8fa7eb7e6 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-3d16a0c3-297e-4f2c-bd1d-6ac380f2f120-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2c6f1d4c-0d32-4f80-ae8f-64f8fa7eb7e6 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "cinder-quobyte-cf3791e5-8418-456e-8b9d-3adb0e086159" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2c6f1d4c-0d32-4f80-ae8f-64f8fa7eb7e6 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-cf3791e5-8418-456e-8b9d-3adb0e086159" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2c6f1d4c-0d32-4f80-ae8f-64f8fa7eb7e6 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "cinder-quobyte-3d16a0c3-297e-4f2c-bd1d-6ac380f2f120" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2c6f1d4c-0d32-4f80-ae8f-64f8fa7eb7e6 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-3d16a0c3-297e-4f2c-bd1d-6ac380f2f120" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:31 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-2c6f1d4c-0d32-4f80-ae8f-64f8fa7eb7e6 tempest-ProjectReaderTests-1922078704 None] Deleting offline snapshot 3d16a0c3-297e-4f2c-bd1d-6ac380f2f120 of volume cf3791e5-8418-456e-8b9d-3adb0e086159 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-2c6f1d4c-0d32-4f80-ae8f-64f8fa7eb7e6 tempest-ProjectReaderTests-1922078704 None] snapshot_file for this snap is: volume-cf3791e5-8418-456e-8b9d-3adb0e086159.3d16a0c3-297e-4f2c-bd1d-6ac380f2f120 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143 1073741824" returned: 0 in 0.628s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed242140-e917-4253-afbf-9180fb5faf60]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2c6f1d4c-0d32-4f80-ae8f-64f8fa7eb7e6 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.3d16a0c3-297e-4f2c-bd1d-6ac380f2f120 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:32 devstack sudo[107463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143
Sep 04 16:08:32 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:32 devstack sudo[107462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.3d16a0c3-297e-4f2c-bd1d-6ac380f2f120
Sep 04 16:08:32 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:32 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143" returned: 0 in 0.328s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:32 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:08:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:32 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa51bc5-9000-49b5-adc3-28a13df1731b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-829a5415-9c4b-473b-bed6-70743841a143', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:32 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09dd8a1c-625b-4f0b-a044-b21002941352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:32 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Volume volume-829a5415-9c4b-473b-bed6-70743841a143 (829a5415-9c4b-473b-bed6-70743841a143): created successfully
Sep 04 16:08:32 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09dd8a1c-625b-4f0b-a044-b21002941352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:32 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Flow 'volume_create_manager' (1dd15d14-63ce-44f9-8865-e828823220f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:32 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-b1c52d61-7b39-40f7-af43-e1aeb1cddaa1 tempest-VolumeDependencyTests-1988327832 None] Created volume successfully.
Sep 04 16:08:32 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2c6f1d4c-0d32-4f80-ae8f-64f8fa7eb7e6 tempest-ProjectReaderTests-1922078704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.3d16a0c3-297e-4f2c-bd1d-6ac380f2f120" returned: 0 in 0.544s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:32 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-2c6f1d4c-0d32-4f80-ae8f-64f8fa7eb7e6 tempest-ProjectReaderTests-1922078704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf3791e5-8418-456e-8b9d-3adb0e086159(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:08:32 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec8bb72-fa74-493e-90a8-2de3c0f3e819]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2c6f1d4c-0d32-4f80-ae8f-64f8fa7eb7e6 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:32 devstack sudo[107470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159
Sep 04 16:08:32 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:32 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2c6f1d4c-0d32-4f80-ae8f-64f8fa7eb7e6 tempest-ProjectReaderTests-1922078704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159" returned: 0 in 0.467s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2c6f1d4c-0d32-4f80-ae8f-64f8fa7eb7e6 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.3d16a0c3-297e-4f2c-bd1d-6ac380f2f120 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:33 devstack sudo[107475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.3d16a0c3-297e-4f2c-bd1d-6ac380f2f120
Sep 04 16:08:33 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:33 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2c6f1d4c-0d32-4f80-ae8f-64f8fa7eb7e6 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.3d16a0c3-297e-4f2c-bd1d-6ac380f2f120" returned: 0 in 0.418s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2c6f1d4c-0d32-4f80-ae8f-64f8fa7eb7e6 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.3d16a0c3-297e-4f2c-bd1d-6ac380f2f120 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:33 devstack sudo[107481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.3d16a0c3-297e-4f2c-bd1d-6ac380f2f120
Sep 04 16:08:33 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:33 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:UPDATE=297,cinder:SELECT=222,cinder:INSERT=81,cinder:DELETE=26 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:08:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0dae2579-3d0b-461a-8865-b355d373411d tempest-VolumeDependencyTests-1988327832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0dae2579-3d0b-461a-8865-b355d373411d tempest-VolumeDependencyTests-1988327832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:33 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-0dae2579-3d0b-461a-8865-b355d373411d tempest-VolumeDependencyTests-1988327832 None] Creating offline snapshot 70e87d3c-fe52-4e9d-9e96-0c26f596a2de of volume 829a5415-9c4b-473b-bed6-70743841a143 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 16:08:33 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b094457-68c6-48d1-a474-2f01ab707908]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0dae2579-3d0b-461a-8865-b355d373411d tempest-VolumeDependencyTests-1988327832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:33 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2c6f1d4c-0d32-4f80-ae8f-64f8fa7eb7e6 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159.3d16a0c3-297e-4f2c-bd1d-6ac380f2f120" returned: 0 in 0.349s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:33 devstack sudo[107483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143
Sep 04 16:08:33 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:33 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2c6f1d4c-0d32-4f80-ae8f-64f8fa7eb7e6 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-3d16a0c3-297e-4f2c-bd1d-6ac380f2f120" released by "_delete_snapshot" :: held 1.928s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:33 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2c6f1d4c-0d32-4f80-ae8f-64f8fa7eb7e6 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-cf3791e5-8418-456e-8b9d-3adb0e086159" released by "delete_snapshot" :: held 1.967s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:33 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=204,cinder:UPDATE=296,cinder:INSERT=76,cinder:DELETE=28 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:08:33 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-2c6f1d4c-0d32-4f80-ae8f-64f8fa7eb7e6 tempest-ProjectReaderTests-1922078704 None] Created reservations ['31ffd732-90d0-49f7-87e8-2c7b2025826e', 'acae7a7f-2648-4edf-bc46-743359f9ccdc', '39252cb4-3a09-43b3-95a6-de714cbd0ec4', '7d60c626-a6b9-415b-9132-21fce25165d2'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:08:33 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-2c6f1d4c-0d32-4f80-ae8f-64f8fa7eb7e6 tempest-ProjectReaderTests-1922078704 None] Delete snapshot completed successfully.
Sep 04 16:08:34 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2c6f1d4c-0d32-4f80-ae8f-64f8fa7eb7e6 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-3d16a0c3-297e-4f2c-bd1d-6ac380f2f120-delete_snapshot" released by "delete_snapshot" :: held 2.208s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:34 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0dae2579-3d0b-461a-8865-b355d373411d tempest-VolumeDependencyTests-1988327832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143" returned: 0 in 0.520s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0dae2579-3d0b-461a-8865-b355d373411d tempest-VolumeDependencyTests-1988327832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.70e87d3c-fe52-4e9d-9e96-0c26f596a2de 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:34 devstack sudo[107489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.70e87d3c-fe52-4e9d-9e96-0c26f596a2de 1G
Sep 04 16:08:34 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:34 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0dae2579-3d0b-461a-8865-b355d373411d tempest-VolumeDependencyTests-1988327832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.70e87d3c-fe52-4e9d-9e96-0c26f596a2de 1G" returned: 0 in 0.517s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0dae2579-3d0b-461a-8865-b355d373411d tempest-VolumeDependencyTests-1988327832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-829a5415-9c4b-473b-bed6-70743841a143 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.70e87d3c-fe52-4e9d-9e96-0c26f596a2de {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:34 devstack sudo[107496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-829a5415-9c4b-473b-bed6-70743841a143 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.70e87d3c-fe52-4e9d-9e96-0c26f596a2de
Sep 04 16:08:34 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:35 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0dae2579-3d0b-461a-8865-b355d373411d tempest-VolumeDependencyTests-1988327832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-829a5415-9c4b-473b-bed6-70743841a143 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.70e87d3c-fe52-4e9d-9e96-0c26f596a2de" returned: 0 in 0.380s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:35 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-0dae2579-3d0b-461a-8865-b355d373411d tempest-VolumeDependencyTests-1988327832 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.70e87d3c-fe52-4e9d-9e96-0c26f596a2de is being set with open permissions: ugo+rw
Sep 04 16:08:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0dae2579-3d0b-461a-8865-b355d373411d tempest-VolumeDependencyTests-1988327832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.70e87d3c-fe52-4e9d-9e96-0c26f596a2de {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:35 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9b438a69-a4c7-49af-aa81-38fe54d01f4d tempest-ProjectReaderTests-1922078704 None] Acquiring lock "cinder-cf3791e5-8418-456e-8b9d-3adb0e086159-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:35 devstack sudo[107503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.70e87d3c-fe52-4e9d-9e96-0c26f596a2de
Sep 04 16:08:35 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:35 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9b438a69-a4c7-49af-aa81-38fe54d01f4d tempest-ProjectReaderTests-1922078704 None] Lock "cinder-cf3791e5-8418-456e-8b9d-3adb0e086159-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:35 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9b438a69-a4c7-49af-aa81-38fe54d01f4d tempest-ProjectReaderTests-1922078704 None] Acquiring lock "cinder-quobyte-cf3791e5-8418-456e-8b9d-3adb0e086159" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:35 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9b438a69-a4c7-49af-aa81-38fe54d01f4d tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-cf3791e5-8418-456e-8b9d-3adb0e086159" acquired by "delete_volume" :: waited 0.019s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:35 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4b68cb-8a2f-43d6-ac2f-193c47e64729]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9b438a69-a4c7-49af-aa81-38fe54d01f4d tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:35 devstack sudo[107505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159
Sep 04 16:08:35 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:35 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0dae2579-3d0b-461a-8865-b355d373411d tempest-VolumeDependencyTests-1988327832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.70e87d3c-fe52-4e9d-9e96-0c26f596a2de" returned: 0 in 0.439s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0dae2579-3d0b-461a-8865-b355d373411d tempest-VolumeDependencyTests-1988327832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:35 devstack sudo[107508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.info
Sep 04 16:08:35 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:35 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9b438a69-a4c7-49af-aa81-38fe54d01f4d tempest-ProjectReaderTests-1922078704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159" returned: 0 in 0.517s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9b438a69-a4c7-49af-aa81-38fe54d01f4d tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:35 devstack sudo[107513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159
Sep 04 16:08:35 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:36 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0dae2579-3d0b-461a-8865-b355d373411d tempest-VolumeDependencyTests-1988327832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.info" returned: 0 in 0.487s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:36 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-0dae2579-3d0b-461a-8865-b355d373411d tempest-VolumeDependencyTests-1988327832 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.info is being set with open permissions: ugo+rw
Sep 04 16:08:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0dae2579-3d0b-461a-8865-b355d373411d tempest-VolumeDependencyTests-1988327832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:36 devstack sudo[107516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.info
Sep 04 16:08:36 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:36 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9b438a69-a4c7-49af-aa81-38fe54d01f4d tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-cf3791e5-8418-456e-8b9d-3adb0e086159" returned: 0 in 0.340s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:36 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9b438a69-a4c7-49af-aa81-38fe54d01f4d tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-cf3791e5-8418-456e-8b9d-3adb0e086159" released by "delete_volume" :: held 0.963s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:36 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-9b438a69-a4c7-49af-aa81-38fe54d01f4d tempest-ProjectReaderTests-1922078704 None] Created reservations ['51204750-1c71-4ad7-849a-88aa02052356', '245d922b-9472-41ac-8692-25397e2bfa26', 'ce8ecc36-8949-435e-bce8-6e455c994a54', 'e857422b-c616-44eb-8329-ebd15ed5f6d6'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:08:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9b438a69-a4c7-49af-aa81-38fe54d01f4d tempest-ProjectReaderTests-1922078704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9b438a69-a4c7-49af-aa81-38fe54d01f4d tempest-ProjectReaderTests-1922078704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:36 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9b438a69-a4c7-49af-aa81-38fe54d01f4d tempest-ProjectReaderTests-1922078704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:36 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-9b438a69-a4c7-49af-aa81-38fe54d01f4d tempest-ProjectReaderTests-1922078704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9b438a69-a4c7-49af-aa81-38fe54d01f4d tempest-ProjectReaderTests-1922078704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9b438a69-a4c7-49af-aa81-38fe54d01f4d tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:36 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0dae2579-3d0b-461a-8865-b355d373411d tempest-VolumeDependencyTests-1988327832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.info" returned: 0 in 0.382s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:36 devstack sudo[107520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:08:36 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0dae2579-3d0b-461a-8865-b355d373411d tempest-VolumeDependencyTests-1988327832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.872s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:36 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-0dae2579-3d0b-461a-8865-b355d373411d tempest-VolumeDependencyTests-1988327832 None] Create snapshot completed successfully
Sep 04 16:08:36 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9b438a69-a4c7-49af-aa81-38fe54d01f4d tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.311s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:36 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-9b438a69-a4c7-49af-aa81-38fe54d01f4d tempest-ProjectReaderTests-1922078704 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:08:36 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-9b438a69-a4c7-49af-aa81-38fe54d01f4d tempest-ProjectReaderTests-1922078704 None] Deleted volume successfully.
Sep 04 16:08:36 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-9b438a69-a4c7-49af-aa81-38fe54d01f4d tempest-ProjectReaderTests-1922078704 None] Lock "cinder-cf3791e5-8418-456e-8b9d-3adb0e086159-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Flow 'volume_create_manager' (af5734e0-ffd9-4406-b2ff-e19198142d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f251fac8-b0de-41ac-9afe-3ca65032d36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f251fac8-b0de-41ac-9afe-3ca65032d36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1192984729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8105b1e-7626-4575-9c4d-4f51f2beb31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d5ff198ced54135a5a8f0ea5d270503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=70e87d3c-fe52-4e9d-9e96-0c26f596a2de,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:38Z,use_quota=True,user_id='45137da81e2d4837917bc342603a4959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0661bda4-c3dd-4593-9677-4183c370ade8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0661bda4-c3dd-4593-9677-4183c370ade8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90967da6-3c7d-4c8d-9a59-e0477edda061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90967da6-3c7d-4c8d-9a59-e0477edda061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c8105b1e-7626-4575-9c4d-4f51f2beb31c', 'volume_name': 'volume-c8105b1e-7626-4575-9c4d-4f51f2beb31c', 'volume_size': 1, 'snapshot_id': '70e87d3c-fe52-4e9d-9e96-0c26f596a2de'}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d785828d-b599-4161-9529-ad67fd99a30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d785828d-b599-4161-9529-ad67fd99a30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5477d829-fb6e-45e8-805a-51c51bf3b42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:37 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Volume c8105b1e-7626-4575-9c4d-4f51f2beb31c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c8105b1e-7626-4575-9c4d-4f51f2beb31c', 'volume_size': 1, 'snapshot_id': '70e87d3c-fe52-4e9d-9e96-0c26f596a2de'}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Acquiring lock "cinder-quobyte-70e87d3c-fe52-4e9d-9e96-0c26f596a2de-c8105b1e-7626-4575-9c4d-4f51f2beb31c" by "_create_volume_from_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Lock "cinder-quobyte-70e87d3c-fe52-4e9d-9e96-0c26f596a2de-c8105b1e-7626-4575-9c4d-4f51f2beb31c" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Creating volume c8105b1e-7626-4575-9c4d-4f51f2beb31c from snapshot 70e87d3c-fe52-4e9d-9e96-0c26f596a2de {{(pid=87504) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Acquiring lock "cinder-quobyte-c8105b1e-7626-4575-9c4d-4f51f2beb31c" by "_copy_volume_from_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Lock "cinder-quobyte-c8105b1e-7626-4575-9c4d-4f51f2beb31c" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] snapshot: 70e87d3c-fe52-4e9d-9e96-0c26f596a2de, volume: c8105b1e-7626-4575-9c4d-4f51f2beb31c,  {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:37 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:38 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3b4921-adde-48b3-9487-27b3398e3b4b]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.70e87d3c-fe52-4e9d-9e96-0c26f596a2de {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:38 devstack sudo[107523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.70e87d3c-fe52-4e9d-9e96-0c26f596a2de
Sep 04 16:08:38 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:38 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:08:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Flow 'volume_create_manager' (806610bb-4e06-48d7-8300-1f90938029f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (291d0050-8610-4c1c-b2ab-03def520fbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (291d0050-8610-4c1c-b2ab-03def520fbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2127125543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ebc30e7-2bf9-48f3-98e0-9be021b142fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07bb09d5823f43dca188c4caaa4b5480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:38Z,use_quota=True,user_id='0b76e0f6fc0e44b7bec703b6fd64ec59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d9eb98-7bf0-4199-b05c-be9c1f603cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d9eb98-7bf0-4199-b05c-be9c1f603cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8434c0b5-2997-4394-a041-eef9e52e0ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8434c0b5-2997-4394-a041-eef9e52e0ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ebc30e7-2bf9-48f3-98e0-9be021b142fb', 'volume_name': 'volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3d0736-cebd-4e7f-9225-7268a4192b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3d0736-cebd-4e7f-9225-7268a4192b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:38 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a453b99-a059-4dc9-a1d7-d5f5d65cd2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:38 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Volume 9ebc30e7-2bf9-48f3-98e0-9be021b142fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb', 'volume_size': 1}
Sep 04 16:08:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:38 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.70e87d3c-fe52-4e9d-9e96-0c26f596a2de" returned: 0 in 0.462s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-829a5415-9c4b-473b-bed6-70743841a143(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:08:38 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2769fc4-caf7-41ee-be19-92411e61de81]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:38 devstack sudo[107528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143
Sep 04 16:08:38 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:38 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143" returned: 0 in 0.395s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143 {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 04 16:08:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Creating direct copy from snapshot {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 04 16:08:38 devstack cinder-volume[87504]: DEBUG cinder.utils [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Path /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8105b1e-7626-4575-9c4d-4f51f2beb31c not found in is_blk_device check {{(pid=87504) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 04 16:08:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8105b1e-7626-4575-9c4d-4f51f2beb31c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:38 devstack sudo[107533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8105b1e-7626-4575-9c4d-4f51f2beb31c
Sep 04 16:08:38 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:43 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8105b1e-7626-4575-9c4d-4f51f2beb31c" returned: 0 in 4.879s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:43 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143, size 1024.00 MB, duration 4.88 sec, destination /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8105b1e-7626-4575-9c4d-4f51f2beb31c {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 16:08:43 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Converted 1024.00 MB image at 209.82 MB/s
Sep 04 16:08:43 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8105b1e-7626-4575-9c4d-4f51f2beb31c is being set with open permissions: ugo+rw
Sep 04 16:08:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8105b1e-7626-4575-9c4d-4f51f2beb31c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:43 devstack sudo[107546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8105b1e-7626-4575-9c4d-4f51f2beb31c
Sep 04 16:08:43 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:44 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8105b1e-7626-4575-9c4d-4f51f2beb31c" returned: 0 in 0.264s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Lock "cinder-quobyte-c8105b1e-7626-4575-9c4d-4f51f2beb31c" released by "_copy_volume_from_snapshot" :: held 6.150s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Lock "cinder-quobyte-70e87d3c-fe52-4e9d-9e96-0c26f596a2de-c8105b1e-7626-4575-9c4d-4f51f2beb31c" released by "_create_volume_from_snapshot" :: held 6.237s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.260s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.795s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2127125543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ebc30e7-2bf9-48f3-98e0-9be021b142fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07bb09d5823f43dca188c4caaa4b5480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:38Z,use_quota=True,user_id='0b76e0f6fc0e44b7bec703b6fd64ec59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Creating volume 9ebc30e7-2bf9-48f3-98e0-9be021b142fb {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:08:44 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:44 devstack sudo[107549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb 1073741824
Sep 04 16:08:44 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5477d829-fb6e-45e8-805a-51c51bf3b42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8105b1e-7626-4575-9c4d-4f51f2beb31c', 'volume_size': 1, 'snapshot_id': '70e87d3c-fe52-4e9d-9e96-0c26f596a2de'}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e4ff96-2784-451a-9721-69186886a0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:44 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Volume volume-c8105b1e-7626-4575-9c4d-4f51f2beb31c (c8105b1e-7626-4575-9c4d-4f51f2beb31c): created successfully
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e4ff96-2784-451a-9721-69186886a0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Flow 'volume_create_manager' (af5734e0-ffd9-4406-b2ff-e19198142d5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:44 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e2ea4598-ebee-454f-85a5-d75eeceba789 tempest-VolumeDependencyTests-1988327832 None] Created volume successfully.
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f0b1315e-741e-425d-bb66-b832f39ae875 tempest-VolumeDependencyTests-1988327832 None] Acquiring lock "cinder-70e87d3c-fe52-4e9d-9e96-0c26f596a2de-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f0b1315e-741e-425d-bb66-b832f39ae875 tempest-VolumeDependencyTests-1988327832 None] Lock "cinder-70e87d3c-fe52-4e9d-9e96-0c26f596a2de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f0b1315e-741e-425d-bb66-b832f39ae875 tempest-VolumeDependencyTests-1988327832 None] Acquiring lock "cinder-quobyte-829a5415-9c4b-473b-bed6-70743841a143" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f0b1315e-741e-425d-bb66-b832f39ae875 tempest-VolumeDependencyTests-1988327832 None] Lock "cinder-quobyte-829a5415-9c4b-473b-bed6-70743841a143" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f0b1315e-741e-425d-bb66-b832f39ae875 tempest-VolumeDependencyTests-1988327832 None] Acquiring lock "cinder-quobyte-70e87d3c-fe52-4e9d-9e96-0c26f596a2de" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f0b1315e-741e-425d-bb66-b832f39ae875 tempest-VolumeDependencyTests-1988327832 None] Lock "cinder-quobyte-70e87d3c-fe52-4e9d-9e96-0c26f596a2de" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-f0b1315e-741e-425d-bb66-b832f39ae875 tempest-VolumeDependencyTests-1988327832 None] Deleting offline snapshot 70e87d3c-fe52-4e9d-9e96-0c26f596a2de of volume 829a5415-9c4b-473b-bed6-70743841a143 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-f0b1315e-741e-425d-bb66-b832f39ae875 tempest-VolumeDependencyTests-1988327832 None] snapshot_file for this snap is: volume-829a5415-9c4b-473b-bed6-70743841a143.70e87d3c-fe52-4e9d-9e96-0c26f596a2de {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[132fb5fb-0db0-4fd9-a953-f8e4554136d8]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f0b1315e-741e-425d-bb66-b832f39ae875 tempest-VolumeDependencyTests-1988327832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.70e87d3c-fe52-4e9d-9e96-0c26f596a2de {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:44 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb 1073741824" returned: 0 in 0.541s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:44 devstack sudo[107555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.70e87d3c-fe52-4e9d-9e96-0c26f596a2de
Sep 04 16:08:44 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:44 devstack sudo[107558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb
Sep 04 16:08:44 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:44 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb" returned: 0 in 0.268s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a453b99-a059-4dc9-a1d7-d5f5d65cd2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:45 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:45 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b70c34-ae5c-4518-b75a-34ae976ede8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f0b1315e-741e-425d-bb66-b832f39ae875 tempest-VolumeDependencyTests-1988327832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.70e87d3c-fe52-4e9d-9e96-0c26f596a2de" returned: 0 in 0.417s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:45 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-f0b1315e-741e-425d-bb66-b832f39ae875 tempest-VolumeDependencyTests-1988327832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-829a5415-9c4b-473b-bed6-70743841a143(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:08:45 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Volume volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb (9ebc30e7-2bf9-48f3-98e0-9be021b142fb): created successfully
Sep 04 16:08:45 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b70c34-ae5c-4518-b75a-34ae976ede8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:45 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Flow 'volume_create_manager' (806610bb-4e06-48d7-8300-1f90938029f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:45 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f1d1c9-50b1-4a44-af75-0b38d9738102]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f0b1315e-741e-425d-bb66-b832f39ae875 tempest-VolumeDependencyTests-1988327832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:45 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-b6401eff-b2c8-489e-8e57-8d21b19a5888 tempest-ProjectReaderTests-1922078704 None] Created volume successfully.
Sep 04 16:08:45 devstack sudo[107565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143
Sep 04 16:08:45 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:45 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f0b1315e-741e-425d-bb66-b832f39ae875 tempest-VolumeDependencyTests-1988327832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143" returned: 0 in 0.579s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f0b1315e-741e-425d-bb66-b832f39ae875 tempest-VolumeDependencyTests-1988327832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.70e87d3c-fe52-4e9d-9e96-0c26f596a2de {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:45 devstack sudo[107570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.70e87d3c-fe52-4e9d-9e96-0c26f596a2de
Sep 04 16:08:45 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:46 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f0b1315e-741e-425d-bb66-b832f39ae875 tempest-VolumeDependencyTests-1988327832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.70e87d3c-fe52-4e9d-9e96-0c26f596a2de" returned: 0 in 0.505s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f0b1315e-741e-425d-bb66-b832f39ae875 tempest-VolumeDependencyTests-1988327832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.70e87d3c-fe52-4e9d-9e96-0c26f596a2de {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:46 devstack sudo[107576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.70e87d3c-fe52-4e9d-9e96-0c26f596a2de
Sep 04 16:08:46 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a7d055bc-f630-4f71-8576-a3e7da7335cb tempest-ProjectReaderTests-1922078704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a7d055bc-f630-4f71-8576-a3e7da7335cb tempest-ProjectReaderTests-1922078704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:46 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-a7d055bc-f630-4f71-8576-a3e7da7335cb tempest-ProjectReaderTests-1922078704 None] Creating offline snapshot 6a6cd3c3-bc7d-4448-b775-9a8f60944d3b of volume 9ebc30e7-2bf9-48f3-98e0-9be021b142fb {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 16:08:46 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78119be-f4e9-478b-a182-0ad5deb71d82]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a7d055bc-f630-4f71-8576-a3e7da7335cb tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:46 devstack sudo[107578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb
Sep 04 16:08:46 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:46 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f0b1315e-741e-425d-bb66-b832f39ae875 tempest-VolumeDependencyTests-1988327832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143.70e87d3c-fe52-4e9d-9e96-0c26f596a2de" returned: 0 in 0.297s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:46 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f0b1315e-741e-425d-bb66-b832f39ae875 tempest-VolumeDependencyTests-1988327832 None] Lock "cinder-quobyte-70e87d3c-fe52-4e9d-9e96-0c26f596a2de" released by "_delete_snapshot" :: held 1.960s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:46 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f0b1315e-741e-425d-bb66-b832f39ae875 tempest-VolumeDependencyTests-1988327832 None] Lock "cinder-quobyte-829a5415-9c4b-473b-bed6-70743841a143" released by "delete_snapshot" :: held 1.988s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:46 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-f0b1315e-741e-425d-bb66-b832f39ae875 tempest-VolumeDependencyTests-1988327832 None] Created reservations ['6733ab6b-1e60-44af-9c2f-6ee68754c49e', 'cf525fab-1149-4d24-8759-3105845f0d83', '623f4a1f-0395-46cb-8b34-cbda12124363', 'a1edb960-16c2-409b-a218-a60f2978ad3c'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:08:46 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f0b1315e-741e-425d-bb66-b832f39ae875 tempest-VolumeDependencyTests-1988327832 None] Delete snapshot completed successfully.
Sep 04 16:08:46 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f0b1315e-741e-425d-bb66-b832f39ae875 tempest-VolumeDependencyTests-1988327832 None] Lock "cinder-70e87d3c-fe52-4e9d-9e96-0c26f596a2de-delete_snapshot" released by "delete_snapshot" :: held 2.255s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:46 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a7d055bc-f630-4f71-8576-a3e7da7335cb tempest-ProjectReaderTests-1922078704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb" returned: 0 in 0.586s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a7d055bc-f630-4f71-8576-a3e7da7335cb tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.6a6cd3c3-bc7d-4448-b775-9a8f60944d3b 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:46 devstack sudo[107585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.6a6cd3c3-bc7d-4448-b775-9a8f60944d3b 1G
Sep 04 16:08:46 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:47 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a7d055bc-f630-4f71-8576-a3e7da7335cb tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.6a6cd3c3-bc7d-4448-b775-9a8f60944d3b 1G" returned: 0 in 0.522s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a7d055bc-f630-4f71-8576-a3e7da7335cb tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.6a6cd3c3-bc7d-4448-b775-9a8f60944d3b {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:47 devstack sudo[107591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.6a6cd3c3-bc7d-4448-b775-9a8f60944d3b
Sep 04 16:08:47 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:47 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a7d055bc-f630-4f71-8576-a3e7da7335cb tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.6a6cd3c3-bc7d-4448-b775-9a8f60944d3b" returned: 0 in 0.331s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:47 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-a7d055bc-f630-4f71-8576-a3e7da7335cb tempest-ProjectReaderTests-1922078704 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.6a6cd3c3-bc7d-4448-b775-9a8f60944d3b is being set with open permissions: ugo+rw
Sep 04 16:08:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a7d055bc-f630-4f71-8576-a3e7da7335cb tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.6a6cd3c3-bc7d-4448-b775-9a8f60944d3b {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:47 devstack sudo[107596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.6a6cd3c3-bc7d-4448-b775-9a8f60944d3b
Sep 04 16:08:47 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4edcbbd9-8d03-4617-9eb9-6e475ba3bda9 tempest-VolumeDependencyTests-1988327832 None] Acquiring lock "cinder-829a5415-9c4b-473b-bed6-70743841a143-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4edcbbd9-8d03-4617-9eb9-6e475ba3bda9 tempest-VolumeDependencyTests-1988327832 None] Lock "cinder-829a5415-9c4b-473b-bed6-70743841a143-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4edcbbd9-8d03-4617-9eb9-6e475ba3bda9 tempest-VolumeDependencyTests-1988327832 None] Acquiring lock "cinder-quobyte-829a5415-9c4b-473b-bed6-70743841a143" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:47 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4edcbbd9-8d03-4617-9eb9-6e475ba3bda9 tempest-VolumeDependencyTests-1988327832 None] Lock "cinder-quobyte-829a5415-9c4b-473b-bed6-70743841a143" acquired by "delete_volume" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:47 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dd3feb-0e1c-4744-b5ed-dc91c9e4f82c]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4edcbbd9-8d03-4617-9eb9-6e475ba3bda9 tempest-VolumeDependencyTests-1988327832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:48 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a7d055bc-f630-4f71-8576-a3e7da7335cb tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.6a6cd3c3-bc7d-4448-b775-9a8f60944d3b" returned: 0 in 0.306s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a7d055bc-f630-4f71-8576-a3e7da7335cb tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:48 devstack sudo[107600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.info
Sep 04 16:08:48 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:48 devstack sudo[107598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143
Sep 04 16:08:48 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:48 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a7d055bc-f630-4f71-8576-a3e7da7335cb tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.info" returned: 0 in 0.280s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:48 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-a7d055bc-f630-4f71-8576-a3e7da7335cb tempest-ProjectReaderTests-1922078704 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.info is being set with open permissions: ugo+rw
Sep 04 16:08:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a7d055bc-f630-4f71-8576-a3e7da7335cb tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:48 devstack sudo[107607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.info
Sep 04 16:08:48 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:48 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4edcbbd9-8d03-4617-9eb9-6e475ba3bda9 tempest-VolumeDependencyTests-1988327832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143" returned: 0 in 0.463s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4edcbbd9-8d03-4617-9eb9-6e475ba3bda9 tempest-VolumeDependencyTests-1988327832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:48 devstack sudo[107610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143
Sep 04 16:08:48 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:48 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a7d055bc-f630-4f71-8576-a3e7da7335cb tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.info" returned: 0 in 0.278s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a7d055bc-f630-4f71-8576-a3e7da7335cb tempest-ProjectReaderTests-1922078704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.417s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:48 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:48 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-a7d055bc-f630-4f71-8576-a3e7da7335cb tempest-ProjectReaderTests-1922078704 None] Create snapshot completed successfully
Sep 04 16:08:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4edcbbd9-8d03-4617-9eb9-6e475ba3bda9 tempest-VolumeDependencyTests-1988327832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-829a5415-9c4b-473b-bed6-70743841a143" returned: 0 in 0.277s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:48 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4edcbbd9-8d03-4617-9eb9-6e475ba3bda9 tempest-VolumeDependencyTests-1988327832 None] Lock "cinder-quobyte-829a5415-9c4b-473b-bed6-70743841a143" released by "delete_volume" :: held 0.824s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:48 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-4edcbbd9-8d03-4617-9eb9-6e475ba3bda9 tempest-VolumeDependencyTests-1988327832 None] Created reservations ['386dbe97-968c-4e70-92a3-fbf96a746c59', '61654fae-fdd8-46f7-ac29-d291f0a08b8e', '744c8e91-b188-4ab0-98d9-7ea7f06503ae', '8403cb8d-6786-4d51-b1c3-072ac6e80e87'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:08:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4edcbbd9-8d03-4617-9eb9-6e475ba3bda9 tempest-VolumeDependencyTests-1988327832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4edcbbd9-8d03-4617-9eb9-6e475ba3bda9 tempest-VolumeDependencyTests-1988327832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4edcbbd9-8d03-4617-9eb9-6e475ba3bda9 tempest-VolumeDependencyTests-1988327832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4edcbbd9-8d03-4617-9eb9-6e475ba3bda9 tempest-VolumeDependencyTests-1988327832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4edcbbd9-8d03-4617-9eb9-6e475ba3bda9 tempest-VolumeDependencyTests-1988327832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4edcbbd9-8d03-4617-9eb9-6e475ba3bda9 tempest-VolumeDependencyTests-1988327832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:48 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 16:08:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:48 devstack sudo[107614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:08:48 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:48 devstack sudo[107615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:08:48 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f4525f9c-31c1-4715-b167-f5e690e7a7f8 tempest-VolumeDependencyTests-1988327832 None] Acquiring lock "cinder-c8105b1e-7626-4575-9c4d-4f51f2beb31c-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f4525f9c-31c1-4715-b167-f5e690e7a7f8 tempest-VolumeDependencyTests-1988327832 None] Lock "cinder-c8105b1e-7626-4575-9c4d-4f51f2beb31c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f4525f9c-31c1-4715-b167-f5e690e7a7f8 tempest-VolumeDependencyTests-1988327832 None] Acquiring lock "cinder-quobyte-c8105b1e-7626-4575-9c4d-4f51f2beb31c" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f4525f9c-31c1-4715-b167-f5e690e7a7f8 tempest-VolumeDependencyTests-1988327832 None] Lock "cinder-quobyte-c8105b1e-7626-4575-9c4d-4f51f2beb31c" acquired by "delete_volume" :: waited 0.019s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e343abf2-1385-4c1b-ab06-70b31ae1af9b]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f4525f9c-31c1-4715-b167-f5e690e7a7f8 tempest-VolumeDependencyTests-1988327832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8105b1e-7626-4575-9c4d-4f51f2beb31c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:49 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4edcbbd9-8d03-4617-9eb9-6e475ba3bda9 tempest-VolumeDependencyTests-1988327832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.396s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-4edcbbd9-8d03-4617-9eb9-6e475ba3bda9 tempest-VolumeDependencyTests-1988327832 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:08:49 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-4edcbbd9-8d03-4617-9eb9-6e475ba3bda9 tempest-VolumeDependencyTests-1988327832 None] Deleted volume successfully.
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4edcbbd9-8d03-4617-9eb9-6e475ba3bda9 tempest-VolumeDependencyTests-1988327832 None] Lock "cinder-829a5415-9c4b-473b-bed6-70743841a143-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:49 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.431s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager._thread_info {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread count: 28 {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread info: [<_MainThread(MainThread, started 131673838448768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131673724603200)>, <Thread(Thread-3 (stat_writer), started daemon 131673723495936)>, <Thread(Rabbit-heartbeat, started daemon 131673723764800)>, <Thread(Thread-5 (_runner), started daemon 131673722269632)>, <Thread(Thread-7 (_runner), started daemon 131673722322112)>, <Thread(fd_logger, started daemon 131673722585024)>, <Thread(privsep_reader, started daemon 131673721593984)>, <Thread(tpool_thread_0, started daemon 131673714706112)>, <Thread(tpool_thread_1, started daemon 131673706313408)>, <Thread(tpool_thread_2, started daemon 131673697920704)>, <Thread(tpool_thread_3, started daemon 131673689528000)>, <Thread(tpool_thread_4, started daemon 131673681135296)>, <Thread(tpool_thread_5, started daemon 131673672726208)>, <Thread(tpool_thread_6, started daemon 131673664317120)>, <Thread(tpool_thread_7, started daemon 131673655908032)>, <Thread(tpool_thread_8, started daemon 131673647498944)>, <Thread(tpool_thread_9, started daemon 131673639089856)>, <Thread(tpool_thread_10, started daemon 131673630680768)>, <Thread(tpool_thread_11, started daemon 131673622271680)>, <Thread(tpool_thread_12, started daemon 131673613862592)>, <Thread(tpool_thread_13, started daemon 131673605453504)>, <Thread(tpool_thread_14, started daemon 131673597044416)>, <Thread(tpool_thread_15, started daemon 131673588635328)>, <Thread(tpool_thread_16, started daemon 131673580226240)>, <Thread(tpool_thread_17, started daemon 131673571817152)>, <Thread(tpool_thread_18, started daemon 131673563408064)>, <Thread(tpool_thread_19, started daemon 131673554998976)>] {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 16:08:49 devstack sudo[107619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8105b1e-7626-4575-9c4d-4f51f2beb31c
Sep 04 16:08:49 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5682f5cb-ab9f-4878-b5c7-badc9e258032 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "cinder-6a6cd3c3-bc7d-4448-b775-9a8f60944d3b-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5682f5cb-ab9f-4878-b5c7-badc9e258032 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-6a6cd3c3-bc7d-4448-b775-9a8f60944d3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5682f5cb-ab9f-4878-b5c7-badc9e258032 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "cinder-quobyte-9ebc30e7-2bf9-48f3-98e0-9be021b142fb" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5682f5cb-ab9f-4878-b5c7-badc9e258032 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-9ebc30e7-2bf9-48f3-98e0-9be021b142fb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5682f5cb-ab9f-4878-b5c7-badc9e258032 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "cinder-quobyte-6a6cd3c3-bc7d-4448-b775-9a8f60944d3b" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5682f5cb-ab9f-4878-b5c7-badc9e258032 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-6a6cd3c3-bc7d-4448-b775-9a8f60944d3b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-5682f5cb-ab9f-4878-b5c7-badc9e258032 tempest-ProjectReaderTests-1922078704 None] Deleting offline snapshot 6a6cd3c3-bc7d-4448-b775-9a8f60944d3b of volume 9ebc30e7-2bf9-48f3-98e0-9be021b142fb {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-5682f5cb-ab9f-4878-b5c7-badc9e258032 tempest-ProjectReaderTests-1922078704 None] snapshot_file for this snap is: volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.6a6cd3c3-bc7d-4448-b775-9a8f60944d3b {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[307242e4-d2cc-4f2f-b1d6-29e82541a6ba]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5682f5cb-ab9f-4878-b5c7-badc9e258032 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.6a6cd3c3-bc7d-4448-b775-9a8f60944d3b {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:49 devstack sudo[107622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.6a6cd3c3-bc7d-4448-b775-9a8f60944d3b
Sep 04 16:08:49 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:49 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f4525f9c-31c1-4715-b167-f5e690e7a7f8 tempest-VolumeDependencyTests-1988327832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8105b1e-7626-4575-9c4d-4f51f2beb31c" returned: 0 in 0.490s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f4525f9c-31c1-4715-b167-f5e690e7a7f8 tempest-VolumeDependencyTests-1988327832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8105b1e-7626-4575-9c4d-4f51f2beb31c {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:49 devstack sudo[107628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8105b1e-7626-4575-9c4d-4f51f2beb31c
Sep 04 16:08:49 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:49 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5682f5cb-ab9f-4878-b5c7-badc9e258032 tempest-ProjectReaderTests-1922078704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.6a6cd3c3-bc7d-4448-b775-9a8f60944d3b" returned: 0 in 0.414s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-5682f5cb-ab9f-4878-b5c7-badc9e258032 tempest-ProjectReaderTests-1922078704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:08:49 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f4525f9c-31c1-4715-b167-f5e690e7a7f8 tempest-VolumeDependencyTests-1988327832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-c8105b1e-7626-4575-9c4d-4f51f2beb31c" returned: 0 in 0.276s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[681a347e-3d3d-462a-a952-193e19fb77e6]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5682f5cb-ab9f-4878-b5c7-badc9e258032 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:49 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f4525f9c-31c1-4715-b167-f5e690e7a7f8 tempest-VolumeDependencyTests-1988327832 None] Lock "cinder-quobyte-c8105b1e-7626-4575-9c4d-4f51f2beb31c" released by "delete_volume" :: held 0.825s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:50 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-f4525f9c-31c1-4715-b167-f5e690e7a7f8 tempest-VolumeDependencyTests-1988327832 None] Created reservations ['4fb7834a-9e8f-4f36-b1ff-0c9bf748b29e', '2a68f9f8-cb2e-43ee-b8f7-e0ee4bcc5067', '70d9424c-96bd-4ad2-b450-1838146ad2b5', 'f72bfdaf-aea0-4914-8e78-cff5b4beb0a2'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:08:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f4525f9c-31c1-4715-b167-f5e690e7a7f8 tempest-VolumeDependencyTests-1988327832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f4525f9c-31c1-4715-b167-f5e690e7a7f8 tempest-VolumeDependencyTests-1988327832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f4525f9c-31c1-4715-b167-f5e690e7a7f8 tempest-VolumeDependencyTests-1988327832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:50 devstack sudo[107634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb
Sep 04 16:08:50 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:50 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f4525f9c-31c1-4715-b167-f5e690e7a7f8 tempest-VolumeDependencyTests-1988327832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f4525f9c-31c1-4715-b167-f5e690e7a7f8 tempest-VolumeDependencyTests-1988327832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f4525f9c-31c1-4715-b167-f5e690e7a7f8 tempest-VolumeDependencyTests-1988327832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:50 devstack sudo[107637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:08:50 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:50 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f4525f9c-31c1-4715-b167-f5e690e7a7f8 tempest-VolumeDependencyTests-1988327832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.310s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:50 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-f4525f9c-31c1-4715-b167-f5e690e7a7f8 tempest-VolumeDependencyTests-1988327832 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:08:50 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f4525f9c-31c1-4715-b167-f5e690e7a7f8 tempest-VolumeDependencyTests-1988327832 None] Deleted volume successfully.
Sep 04 16:08:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f4525f9c-31c1-4715-b167-f5e690e7a7f8 tempest-VolumeDependencyTests-1988327832 None] Lock "cinder-c8105b1e-7626-4575-9c4d-4f51f2beb31c-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:50 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5682f5cb-ab9f-4878-b5c7-badc9e258032 tempest-ProjectReaderTests-1922078704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb" returned: 0 in 0.528s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5682f5cb-ab9f-4878-b5c7-badc9e258032 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.6a6cd3c3-bc7d-4448-b775-9a8f60944d3b {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:50 devstack sudo[107643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.6a6cd3c3-bc7d-4448-b775-9a8f60944d3b
Sep 04 16:08:50 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:50 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5682f5cb-ab9f-4878-b5c7-badc9e258032 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.6a6cd3c3-bc7d-4448-b775-9a8f60944d3b" returned: 0 in 0.381s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5682f5cb-ab9f-4878-b5c7-badc9e258032 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.6a6cd3c3-bc7d-4448-b775-9a8f60944d3b {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:50 devstack sudo[107648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.6a6cd3c3-bc7d-4448-b775-9a8f60944d3b
Sep 04 16:08:50 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:51 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5682f5cb-ab9f-4878-b5c7-badc9e258032 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb.6a6cd3c3-bc7d-4448-b775-9a8f60944d3b" returned: 0 in 0.279s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5682f5cb-ab9f-4878-b5c7-badc9e258032 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-6a6cd3c3-bc7d-4448-b775-9a8f60944d3b" released by "_delete_snapshot" :: held 1.725s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5682f5cb-ab9f-4878-b5c7-badc9e258032 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-9ebc30e7-2bf9-48f3-98e0-9be021b142fb" released by "delete_snapshot" :: held 1.749s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:51 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-5682f5cb-ab9f-4878-b5c7-badc9e258032 tempest-ProjectReaderTests-1922078704 None] Created reservations ['95c53a61-9232-49f5-8a5c-8f3df71bf00e', '7babb580-2230-4697-b33f-07c336e19038', '43eb58f0-6c53-4c9f-a789-85d02f0d04b2', 'e506781a-fa83-4e46-94d9-406981d40570'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:08:51 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-5682f5cb-ab9f-4878-b5c7-badc9e258032 tempest-ProjectReaderTests-1922078704 None] Delete snapshot completed successfully.
Sep 04 16:08:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-5682f5cb-ab9f-4878-b5c7-badc9e258032 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-6a6cd3c3-bc7d-4448-b775-9a8f60944d3b-delete_snapshot" released by "delete_snapshot" :: held 1.947s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8b2d34e2-7434-47b4-8344-2a68790511d7 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "cinder-9ebc30e7-2bf9-48f3-98e0-9be021b142fb-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8b2d34e2-7434-47b4-8344-2a68790511d7 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-9ebc30e7-2bf9-48f3-98e0-9be021b142fb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8b2d34e2-7434-47b4-8344-2a68790511d7 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "cinder-quobyte-9ebc30e7-2bf9-48f3-98e0-9be021b142fb" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8b2d34e2-7434-47b4-8344-2a68790511d7 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-9ebc30e7-2bf9-48f3-98e0-9be021b142fb" acquired by "delete_volume" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:51 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06170f2-9cfc-42e7-ab02-7eda981dd63f]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8b2d34e2-7434-47b4-8344-2a68790511d7 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:51 devstack sudo[107651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb
Sep 04 16:08:51 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:52 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8b2d34e2-7434-47b4-8344-2a68790511d7 tempest-ProjectReaderTests-1922078704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb" returned: 0 in 0.466s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8b2d34e2-7434-47b4-8344-2a68790511d7 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:52 devstack sudo[107657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb
Sep 04 16:08:52 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:52 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8b2d34e2-7434-47b4-8344-2a68790511d7 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9ebc30e7-2bf9-48f3-98e0-9be021b142fb" returned: 0 in 0.252s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8b2d34e2-7434-47b4-8344-2a68790511d7 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-9ebc30e7-2bf9-48f3-98e0-9be021b142fb" released by "delete_volume" :: held 0.800s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:52 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-8b2d34e2-7434-47b4-8344-2a68790511d7 tempest-ProjectReaderTests-1922078704 None] Created reservations ['2126f48c-b69d-4fc9-ba2d-70d09fe67f41', 'dbcf4c29-3720-47a6-a06c-94141464b505', '01ea68cd-9d1d-4c5e-aa04-341a64543a3a', '7b0076e7-7827-45c5-b1c5-b6496ccdc8ee'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:08:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-8b2d34e2-7434-47b4-8344-2a68790511d7 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-8b2d34e2-7434-47b4-8344-2a68790511d7 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:52 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-8b2d34e2-7434-47b4-8344-2a68790511d7 tempest-ProjectReaderTests-1922078704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:52 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-8b2d34e2-7434-47b4-8344-2a68790511d7 tempest-ProjectReaderTests-1922078704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-8b2d34e2-7434-47b4-8344-2a68790511d7 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8b2d34e2-7434-47b4-8344-2a68790511d7 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:52 devstack sudo[107660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:08:52 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:52 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-8b2d34e2-7434-47b4-8344-2a68790511d7 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.288s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:52 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-8b2d34e2-7434-47b4-8344-2a68790511d7 tempest-ProjectReaderTests-1922078704 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:08:53 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-8b2d34e2-7434-47b4-8344-2a68790511d7 tempest-ProjectReaderTests-1922078704 None] Deleted volume successfully.
Sep 04 16:08:53 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-8b2d34e2-7434-47b4-8344-2a68790511d7 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-9ebc30e7-2bf9-48f3-98e0-9be021b142fb-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:08:53 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:08:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Flow 'volume_create_manager' (9aacdb23-3fe7-4f29-b357-43ec4913428c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f567e97d-af6e-4c62-b42a-26be7f333137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f567e97d-af6e-4c62-b42a-26be7f333137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1074041470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9ec082-b5c2-49fc-9605-12518bfb4080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07bb09d5823f43dca188c4caaa4b5480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:54Z,use_quota=True,user_id='0b76e0f6fc0e44b7bec703b6fd64ec59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073312e5-bb25-49dd-9073-7ddde31877ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073312e5-bb25-49dd-9073-7ddde31877ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3900e6-7969-404f-b711-c45a4ebc7e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3900e6-7969-404f-b711-c45a4ebc7e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f9ec082-b5c2-49fc-9605-12518bfb4080', 'volume_name': 'volume-7f9ec082-b5c2-49fc-9605-12518bfb4080', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6713e148-4e43-4244-986c-1304a8a0c3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6713e148-4e43-4244-986c-1304a8a0c3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9013fed8-50b8-4a5a-8a13-23074d183c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:53 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Volume 7f9ec082-b5c2-49fc-9605-12518bfb4080: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f9ec082-b5c2-49fc-9605-12518bfb4080', 'volume_size': 1}
Sep 04 16:08:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1074041470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9ec082-b5c2-49fc-9605-12518bfb4080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07bb09d5823f43dca188c4caaa4b5480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:54Z,use_quota=True,user_id='0b76e0f6fc0e44b7bec703b6fd64ec59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:08:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Creating volume 7f9ec082-b5c2-49fc-9605-12518bfb4080 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:08:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:08:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:08:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:08:53 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:08:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:53 devstack sudo[107663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080 1073741824
Sep 04 16:08:53 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:54 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080 1073741824" returned: 0 in 0.568s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:54 devstack sudo[107668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080
Sep 04 16:08:54 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:54 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080" returned: 0 in 0.315s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:54 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:08:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9013fed8-50b8-4a5a-8a13-23074d183c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f9ec082-b5c2-49fc-9605-12518bfb4080', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed74ae9-b93c-4d55-b1e3-d72546148ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:08:54 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Volume volume-7f9ec082-b5c2-49fc-9605-12518bfb4080 (7f9ec082-b5c2-49fc-9605-12518bfb4080): created successfully
Sep 04 16:08:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed74ae9-b93c-4d55-b1e3-d72546148ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:08:54 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Flow 'volume_create_manager' (9aacdb23-3fe7-4f29-b357-43ec4913428c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:08:54 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-7324084c-89c9-4ef2-bd8c-d01f08f6b55f tempest-ProjectReaderTests-1922078704 None] Created volume successfully.
Sep 04 16:08:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a95aeccf-cd70-499b-819e-54bf2761ee2d tempest-ProjectReaderTests-1922078704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:08:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a95aeccf-cd70-499b-819e-54bf2761ee2d tempest-ProjectReaderTests-1922078704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:08:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-a95aeccf-cd70-499b-819e-54bf2761ee2d tempest-ProjectReaderTests-1922078704 None] Creating offline snapshot f9e857be-68b8-4e11-89f9-6701503ebd44 of volume 7f9ec082-b5c2-49fc-9605-12518bfb4080 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 16:08:56 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[092439bb-9c31-4f7d-8196-07380ec98593]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a95aeccf-cd70-499b-819e-54bf2761ee2d tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:56 devstack sudo[107672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080
Sep 04 16:08:56 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:56 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a95aeccf-cd70-499b-819e-54bf2761ee2d tempest-ProjectReaderTests-1922078704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080" returned: 0 in 0.478s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a95aeccf-cd70-499b-819e-54bf2761ee2d tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.f9e857be-68b8-4e11-89f9-6701503ebd44 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:56 devstack sudo[107677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.f9e857be-68b8-4e11-89f9-6701503ebd44 1G
Sep 04 16:08:56 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:57 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a95aeccf-cd70-499b-819e-54bf2761ee2d tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.f9e857be-68b8-4e11-89f9-6701503ebd44 1G" returned: 0 in 0.551s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a95aeccf-cd70-499b-819e-54bf2761ee2d tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f9ec082-b5c2-49fc-9605-12518bfb4080 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.f9e857be-68b8-4e11-89f9-6701503ebd44 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:57 devstack sudo[107684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f9ec082-b5c2-49fc-9605-12518bfb4080 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.f9e857be-68b8-4e11-89f9-6701503ebd44
Sep 04 16:08:57 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:57 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a95aeccf-cd70-499b-819e-54bf2761ee2d tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f9ec082-b5c2-49fc-9605-12518bfb4080 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.f9e857be-68b8-4e11-89f9-6701503ebd44" returned: 0 in 0.325s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:57 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-a95aeccf-cd70-499b-819e-54bf2761ee2d tempest-ProjectReaderTests-1922078704 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.f9e857be-68b8-4e11-89f9-6701503ebd44 is being set with open permissions: ugo+rw
Sep 04 16:08:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a95aeccf-cd70-499b-819e-54bf2761ee2d tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.f9e857be-68b8-4e11-89f9-6701503ebd44 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:57 devstack sudo[107689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.f9e857be-68b8-4e11-89f9-6701503ebd44
Sep 04 16:08:57 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:57 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a95aeccf-cd70-499b-819e-54bf2761ee2d tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.f9e857be-68b8-4e11-89f9-6701503ebd44" returned: 0 in 0.266s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a95aeccf-cd70-499b-819e-54bf2761ee2d tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:57 devstack sudo[107692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.info
Sep 04 16:08:57 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:57 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a95aeccf-cd70-499b-819e-54bf2761ee2d tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.info" returned: 0 in 0.299s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:57 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-a95aeccf-cd70-499b-819e-54bf2761ee2d tempest-ProjectReaderTests-1922078704 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.info is being set with open permissions: ugo+rw
Sep 04 16:08:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a95aeccf-cd70-499b-819e-54bf2761ee2d tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:58 devstack sudo[107695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.info
Sep 04 16:08:58 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:58 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a95aeccf-cd70-499b-819e-54bf2761ee2d tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.info" returned: 0 in 0.315s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a95aeccf-cd70-499b-819e-54bf2761ee2d tempest-ProjectReaderTests-1922078704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.345s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:08:58 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-a95aeccf-cd70-499b-819e-54bf2761ee2d tempest-ProjectReaderTests-1922078704 None] Create snapshot completed successfully
Sep 04 16:08:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f1089023-df6d-4eea-b4c4-65549043d494 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "cinder-f9e857be-68b8-4e11-89f9-6701503ebd44-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f1089023-df6d-4eea-b4c4-65549043d494 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-f9e857be-68b8-4e11-89f9-6701503ebd44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f1089023-df6d-4eea-b4c4-65549043d494 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "cinder-quobyte-7f9ec082-b5c2-49fc-9605-12518bfb4080" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f1089023-df6d-4eea-b4c4-65549043d494 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-7f9ec082-b5c2-49fc-9605-12518bfb4080" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f1089023-df6d-4eea-b4c4-65549043d494 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "cinder-quobyte-f9e857be-68b8-4e11-89f9-6701503ebd44" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:08:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f1089023-df6d-4eea-b4c4-65549043d494 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-f9e857be-68b8-4e11-89f9-6701503ebd44" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:08:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-f1089023-df6d-4eea-b4c4-65549043d494 tempest-ProjectReaderTests-1922078704 None] Deleting offline snapshot f9e857be-68b8-4e11-89f9-6701503ebd44 of volume 7f9ec082-b5c2-49fc-9605-12518bfb4080 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 16:08:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-f1089023-df6d-4eea-b4c4-65549043d494 tempest-ProjectReaderTests-1922078704 None] snapshot_file for this snap is: volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.f9e857be-68b8-4e11-89f9-6701503ebd44 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 16:08:59 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50290e9-a485-46c9-90a9-6612d2d42aa1]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f1089023-df6d-4eea-b4c4-65549043d494 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.f9e857be-68b8-4e11-89f9-6701503ebd44 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:59 devstack sudo[107698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.f9e857be-68b8-4e11-89f9-6701503ebd44
Sep 04 16:08:59 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:08:59 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root
Sep 04 16:08:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f1089023-df6d-4eea-b4c4-65549043d494 tempest-ProjectReaderTests-1922078704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.f9e857be-68b8-4e11-89f9-6701503ebd44" returned: 0 in 0.442s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:08:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-f1089023-df6d-4eea-b4c4-65549043d494 tempest-ProjectReaderTests-1922078704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f9ec082-b5c2-49fc-9605-12518bfb4080(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:08:59 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cf32ea-9abe-4d67-bbd8-fca03ac654dc]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:08:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f1089023-df6d-4eea-b4c4-65549043d494 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:08:59 devstack sudo[107703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080
Sep 04 16:08:59 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:00 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f1089023-df6d-4eea-b4c4-65549043d494 tempest-ProjectReaderTests-1922078704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080" returned: 0 in 0.427s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f1089023-df6d-4eea-b4c4-65549043d494 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.f9e857be-68b8-4e11-89f9-6701503ebd44 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:00 devstack sudo[107708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.f9e857be-68b8-4e11-89f9-6701503ebd44
Sep 04 16:09:00 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Flow 'volume_create_manager' (e88e9558-bfc3-4703-878c-60ce2362791d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85fdbbfd-51a4-42ed-87d3-01f83b644ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85fdbbfd-51a4-42ed-87d3-01f83b644ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-310719090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3566c238-2b55-4ec9-989c-2cf7e63b311f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='252e9b9112754b4585a64befebd453e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:00Z,use_quota=True,user_id='034ab799032243669d2f0674e1cee63a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4d64b7c-5ad6-4e13-afac-65b2633e548d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4d64b7c-5ad6-4e13-afac-65b2633e548d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb7de4b-3db6-4fc9-b1f8-9ffbe3a91569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb7de4b-3db6-4fc9-b1f8-9ffbe3a91569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3566c238-2b55-4ec9-989c-2cf7e63b311f', 'volume_name': 'volume-3566c238-2b55-4ec9-989c-2cf7e63b311f', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb61e6be-28e3-410c-b928-24cf922505ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb61e6be-28e3-410c-b928-24cf922505ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bd9d704-c076-4bce-ac7e-ce7363e510ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:00 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Volume 3566c238-2b55-4ec9-989c-2cf7e63b311f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3566c238-2b55-4ec9-989c-2cf7e63b311f', 'volume_size': 1}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-310719090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3566c238-2b55-4ec9-989c-2cf7e63b311f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='252e9b9112754b4585a64befebd453e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:00Z,use_quota=True,user_id='034ab799032243669d2f0674e1cee63a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Creating volume 3566c238-2b55-4ec9-989c-2cf7e63b311f {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:09:00 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:00 devstack sudo[107710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f 1073741824
Sep 04 16:09:00 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Flow 'volume_create_manager' (cd25f671-2c2e-4212-9f49-302d654b7ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705d7309-b9e0-469c-af85-455b6d9d028a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705d7309-b9e0-469c-af85-455b6d9d028a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2138545050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f6d366-b06c-4e76-8a48-1a86d58c33a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3bec3eae6a463fbbef6576bb85077b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:00Z,use_quota=True,user_id='fccb6cabb20d46fa8276df523be9732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd93733a-7e20-428a-aac5-a5b1727398fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd93733a-7e20-428a-aac5-a5b1727398fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa472ed3-8dc0-4bdd-ae5b-6b303110c444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa472ed3-8dc0-4bdd-ae5b-6b303110c444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0f6d366-b06c-4e76-8a48-1a86d58c33a3', 'volume_name': 'volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f0b449-1ac1-4e54-acaf-055cecc6fda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f0b449-1ac1-4e54-acaf-055cecc6fda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee0aef08-186b-4d8d-b9a0-26a5d30181c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:00 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Volume a0f6d366-b06c-4e76-8a48-1a86d58c33a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3', 'volume_size': 1}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:00 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f1089023-df6d-4eea-b4c4-65549043d494 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.f9e857be-68b8-4e11-89f9-6701503ebd44" returned: 0 in 0.372s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f1089023-df6d-4eea-b4c4-65549043d494 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.f9e857be-68b8-4e11-89f9-6701503ebd44 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:00 devstack sudo[107715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.f9e857be-68b8-4e11-89f9-6701503ebd44
Sep 04 16:09:00 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:00 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f 1073741824" returned: 0 in 0.410s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:00 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f1089023-df6d-4eea-b4c4-65549043d494 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080.f9e857be-68b8-4e11-89f9-6701503ebd44" returned: 0 in 0.250s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:00 devstack sudo[107721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f
Sep 04 16:09:00 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f1089023-df6d-4eea-b4c4-65549043d494 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-f9e857be-68b8-4e11-89f9-6701503ebd44" released by "_delete_snapshot" :: held 1.611s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f1089023-df6d-4eea-b4c4-65549043d494 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-7f9ec082-b5c2-49fc-9605-12518bfb4080" released by "delete_snapshot" :: held 1.648s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:00 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-f1089023-df6d-4eea-b4c4-65549043d494 tempest-ProjectReaderTests-1922078704 None] Created reservations ['c40b3efd-a827-421f-a649-cc97fe775dea', 'e47c7374-0ddc-4766-9516-b024699cd270', '1d3e2e6d-6b68-4783-bef1-888036231775', 'd24f281d-cc77-4abe-bb7a-95e97e68ddcd'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:09:01 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f1089023-df6d-4eea-b4c4-65549043d494 tempest-ProjectReaderTests-1922078704 None] Delete snapshot completed successfully.
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f1089023-df6d-4eea-b4c4-65549043d494 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-f9e857be-68b8-4e11-89f9-6701503ebd44-delete_snapshot" released by "delete_snapshot" :: held 1.788s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:01 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f" returned: 0 in 0.259s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.594s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2138545050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f6d366-b06c-4e76-8a48-1a86d58c33a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3bec3eae6a463fbbef6576bb85077b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:00Z,use_quota=True,user_id='fccb6cabb20d46fa8276df523be9732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Creating volume a0f6d366-b06c-4e76-8a48-1a86d58c33a3 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:09:01 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bd9d704-c076-4bce-ac7e-ce7363e510ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3566c238-2b55-4ec9-989c-2cf7e63b311f', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:01 devstack sudo[107724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3 1073741824
Sep 04 16:09:01 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f6ff907-562b-4c23-927c-4c7422978708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:01 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Volume volume-3566c238-2b55-4ec9-989c-2cf7e63b311f (3566c238-2b55-4ec9-989c-2cf7e63b311f): created successfully
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f6ff907-562b-4c23-927c-4c7422978708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Flow 'volume_create_manager' (e88e9558-bfc3-4703-878c-60ce2362791d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:01 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-fb18422d-5619-4587-a1e0-08b3d09fcd51 tempest-SnapshotDependencyTests-2114230018 None] Created volume successfully.
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4ba5f183-795e-4992-8346-761f47d815f7 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "cinder-7f9ec082-b5c2-49fc-9605-12518bfb4080-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4ba5f183-795e-4992-8346-761f47d815f7 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-7f9ec082-b5c2-49fc-9605-12518bfb4080-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4ba5f183-795e-4992-8346-761f47d815f7 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "cinder-quobyte-7f9ec082-b5c2-49fc-9605-12518bfb4080" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4ba5f183-795e-4992-8346-761f47d815f7 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-7f9ec082-b5c2-49fc-9605-12518bfb4080" acquired by "delete_volume" :: waited 0.014s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c767399a-e7ec-4157-9f35-8ebfca354593]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4ba5f183-795e-4992-8346-761f47d815f7 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:01 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3 1073741824" returned: 0 in 0.459s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:01 devstack sudo[107730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080
Sep 04 16:09:01 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:01 devstack sudo[107731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3
Sep 04 16:09:01 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:01 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4ba5f183-795e-4992-8346-761f47d815f7 tempest-ProjectReaderTests-1922078704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080" returned: 0 in 0.356s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4ba5f183-795e-4992-8346-761f47d815f7 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:01 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3" returned: 0 in 0.274s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:01 devstack sudo[107738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee0aef08-186b-4d8d-b9a0-26a5d30181c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:01 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0545d30e-70b1-4741-809a-dd493446ee0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:01 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Volume volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3 (a0f6d366-b06c-4e76-8a48-1a86d58c33a3): created successfully
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0545d30e-70b1-4741-809a-dd493446ee0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:01 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Flow 'volume_create_manager' (cd25f671-2c2e-4212-9f49-302d654b7ac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:01 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-5dd74d24-6aa8-449c-96b6-237146005dd3 tempest-ProjectMemberTests-369224070 None] Created volume successfully.
Sep 04 16:09:02 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4ba5f183-795e-4992-8346-761f47d815f7 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-7f9ec082-b5c2-49fc-9605-12518bfb4080" returned: 0 in 0.253s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:02 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4ba5f183-795e-4992-8346-761f47d815f7 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-7f9ec082-b5c2-49fc-9605-12518bfb4080" released by "delete_volume" :: held 0.671s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:02 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-4ba5f183-795e-4992-8346-761f47d815f7 tempest-ProjectReaderTests-1922078704 None] Created reservations ['ac849027-e1a0-4970-8689-dc2c6a6e4ca8', '3893614a-83e8-467d-8173-05328685d4c8', '4c14b3b4-f31a-40e2-9f30-03917d39a282', '53500f6e-7542-434d-8a54-fcd4af4b6ee4'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:09:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4ba5f183-795e-4992-8346-761f47d815f7 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4ba5f183-795e-4992-8346-761f47d815f7 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:02 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4ba5f183-795e-4992-8346-761f47d815f7 tempest-ProjectReaderTests-1922078704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:02 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4ba5f183-795e-4992-8346-761f47d815f7 tempest-ProjectReaderTests-1922078704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4ba5f183-795e-4992-8346-761f47d815f7 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4ba5f183-795e-4992-8346-761f47d815f7 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:02 devstack sudo[107741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:09:02 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0bdcdc6d-72d6-4b51-9d48-7b4b32cce63c tempest-SnapshotDependencyTests-2114230018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0bdcdc6d-72d6-4b51-9d48-7b4b32cce63c tempest-SnapshotDependencyTests-2114230018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:02 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-0bdcdc6d-72d6-4b51-9d48-7b4b32cce63c tempest-SnapshotDependencyTests-2114230018 None] Creating offline snapshot dc985770-207a-45c5-8a52-d5bf6fae8ac9 of volume 3566c238-2b55-4ec9-989c-2cf7e63b311f {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 16:09:02 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4ba5f183-795e-4992-8346-761f47d815f7 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.338s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:02 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-4ba5f183-795e-4992-8346-761f47d815f7 tempest-ProjectReaderTests-1922078704 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:09:02 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-4ba5f183-795e-4992-8346-761f47d815f7 tempest-ProjectReaderTests-1922078704 None] Deleted volume successfully.
Sep 04 16:09:02 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[18db49cc-f1ab-499c-a5ef-d1174ac7cb54]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0bdcdc6d-72d6-4b51-9d48-7b4b32cce63c tempest-SnapshotDependencyTests-2114230018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:02 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4ba5f183-795e-4992-8346-761f47d815f7 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-7f9ec082-b5c2-49fc-9605-12518bfb4080-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2deba72c-ac57-4ed6-b1df-7657f3265d78 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:02 devstack sudo[107744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f
Sep 04 16:09:02 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:03 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0bdcdc6d-72d6-4b51-9d48-7b4b32cce63c tempest-SnapshotDependencyTests-2114230018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f" returned: 0 in 0.396s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0bdcdc6d-72d6-4b51-9d48-7b4b32cce63c tempest-SnapshotDependencyTests-2114230018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.dc985770-207a-45c5-8a52-d5bf6fae8ac9 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:03 devstack sudo[107749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.dc985770-207a-45c5-8a52-d5bf6fae8ac9 1G
Sep 04 16:09:03 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:03 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:09:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Flow 'volume_create_manager' (0e2e7aa0-aae9-44cb-b2d3-6b1009ffe4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae10d36-9c3b-4336-a637-592c44a85460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae10d36-9c3b-4336-a637-592c44a85460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1482709251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d48155f8-834e-4435-9934-0bfbccd2edfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07bb09d5823f43dca188c4caaa4b5480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:03Z,use_quota=True,user_id='0b76e0f6fc0e44b7bec703b6fd64ec59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9317cb14-018c-445c-8ad0-e22d66f48f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9317cb14-018c-445c-8ad0-e22d66f48f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac69fdbe-34e4-47ff-8e2d-f603ff790776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac69fdbe-34e4-47ff-8e2d-f603ff790776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd48155f8-834e-4435-9934-0bfbccd2edfe', 'volume_name': 'volume-d48155f8-834e-4435-9934-0bfbccd2edfe', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7953728a-6e38-4c90-9055-7fbce5e2862f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7953728a-6e38-4c90-9055-7fbce5e2862f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:03 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ef73e1e-e0ef-42f8-90ae-6d8b19a62c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:03 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Volume d48155f8-834e-4435-9934-0bfbccd2edfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d48155f8-834e-4435-9934-0bfbccd2edfe', 'volume_size': 1}
Sep 04 16:09:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:03 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0bdcdc6d-72d6-4b51-9d48-7b4b32cce63c tempest-SnapshotDependencyTests-2114230018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.dc985770-207a-45c5-8a52-d5bf6fae8ac9 1G" returned: 0 in 0.418s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0bdcdc6d-72d6-4b51-9d48-7b4b32cce63c tempest-SnapshotDependencyTests-2114230018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3566c238-2b55-4ec9-989c-2cf7e63b311f -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.dc985770-207a-45c5-8a52-d5bf6fae8ac9 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:03 devstack sudo[107754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3566c238-2b55-4ec9-989c-2cf7e63b311f -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.dc985770-207a-45c5-8a52-d5bf6fae8ac9
Sep 04 16:09:03 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:03 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0bdcdc6d-72d6-4b51-9d48-7b4b32cce63c tempest-SnapshotDependencyTests-2114230018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3566c238-2b55-4ec9-989c-2cf7e63b311f -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.dc985770-207a-45c5-8a52-d5bf6fae8ac9" returned: 0 in 0.279s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:03 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-0bdcdc6d-72d6-4b51-9d48-7b4b32cce63c tempest-SnapshotDependencyTests-2114230018 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.dc985770-207a-45c5-8a52-d5bf6fae8ac9 is being set with open permissions: ugo+rw
Sep 04 16:09:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0bdcdc6d-72d6-4b51-9d48-7b4b32cce63c tempest-SnapshotDependencyTests-2114230018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.dc985770-207a-45c5-8a52-d5bf6fae8ac9 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:03 devstack sudo[107759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.dc985770-207a-45c5-8a52-d5bf6fae8ac9
Sep 04 16:09:03 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:04 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0bdcdc6d-72d6-4b51-9d48-7b4b32cce63c tempest-SnapshotDependencyTests-2114230018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.dc985770-207a-45c5-8a52-d5bf6fae8ac9" returned: 0 in 0.230s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0bdcdc6d-72d6-4b51-9d48-7b4b32cce63c tempest-SnapshotDependencyTests-2114230018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:04 devstack sudo[107762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.info
Sep 04 16:09:04 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:04 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0bdcdc6d-72d6-4b51-9d48-7b4b32cce63c tempest-SnapshotDependencyTests-2114230018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.info" returned: 0 in 0.240s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:04 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-0bdcdc6d-72d6-4b51-9d48-7b4b32cce63c tempest-SnapshotDependencyTests-2114230018 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.info is being set with open permissions: ugo+rw
Sep 04 16:09:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0bdcdc6d-72d6-4b51-9d48-7b4b32cce63c tempest-SnapshotDependencyTests-2114230018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:04 devstack sudo[107765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.info
Sep 04 16:09:04 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:04 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-0bdcdc6d-72d6-4b51-9d48-7b4b32cce63c tempest-SnapshotDependencyTests-2114230018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.info" returned: 0 in 0.239s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-0bdcdc6d-72d6-4b51-9d48-7b4b32cce63c tempest-SnapshotDependencyTests-2114230018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.918s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2deba72c-ac57-4ed6-b1df-7657f3265d78 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.808s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:04 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-2deba72c-ac57-4ed6-b1df-7657f3265d78 tempest-ProjectMemberTests-369224070 None] Creating offline snapshot e24f89c1-ec5b-46f4-9bfe-3f695d660169 of volume a0f6d366-b06c-4e76-8a48-1a86d58c33a3 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 16:09:04 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-0bdcdc6d-72d6-4b51-9d48-7b4b32cce63c tempest-SnapshotDependencyTests-2114230018 None] Create snapshot completed successfully
Sep 04 16:09:04 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af2ae6c-1081-4f7f-826d-98f6c4f6d76d]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2deba72c-ac57-4ed6-b1df-7657f3265d78 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:04 devstack sudo[107768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3
Sep 04 16:09:04 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:04 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2deba72c-ac57-4ed6-b1df-7657f3265d78 tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3" returned: 0 in 0.379s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2deba72c-ac57-4ed6-b1df-7657f3265d78 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.e24f89c1-ec5b-46f4-9bfe-3f695d660169 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:04 devstack sudo[107774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.e24f89c1-ec5b-46f4-9bfe-3f695d660169 1G
Sep 04 16:09:04 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:05 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:09:05 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2deba72c-ac57-4ed6-b1df-7657f3265d78 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.e24f89c1-ec5b-46f4-9bfe-3f695d660169 1G" returned: 0 in 0.443s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2deba72c-ac57-4ed6-b1df-7657f3265d78 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.e24f89c1-ec5b-46f4-9bfe-3f695d660169 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:05 devstack sudo[107779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.e24f89c1-ec5b-46f4-9bfe-3f695d660169
Sep 04 16:09:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Flow 'volume_create_manager' (0cca33fc-921d-4111-94e5-55e6a0f1620b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:05 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743bed7c-26dc-467e-a63f-e749c20ac5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743bed7c-26dc-467e-a63f-e749c20ac5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7d72b9-391e-49ea-8d32-a926ac103826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='252e9b9112754b4585a64befebd453e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dc985770-207a-45c5-8a52-d5bf6fae8ac9,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:05Z,use_quota=True,user_id='034ab799032243669d2f0674e1cee63a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11036b56-0b13-47f9-9230-c8a6b3648b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11036b56-0b13-47f9-9230-c8a6b3648b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744c9e32-28ac-454e-b1e7-e054df58451e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744c9e32-28ac-454e-b1e7-e054df58451e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9b7d72b9-391e-49ea-8d32-a926ac103826', 'volume_name': 'volume-9b7d72b9-391e-49ea-8d32-a926ac103826', 'volume_size': 1, 'snapshot_id': 'dc985770-207a-45c5-8a52-d5bf6fae8ac9'}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8562afae-552b-430c-8c03-e838d9c8de03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8562afae-552b-430c-8c03-e838d9c8de03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:05 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf8e606-9214-4a89-a00b-7d37cdcdd224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:05 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Volume 9b7d72b9-391e-49ea-8d32-a926ac103826: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9b7d72b9-391e-49ea-8d32-a926ac103826', 'volume_size': 1, 'snapshot_id': 'dc985770-207a-45c5-8a52-d5bf6fae8ac9'}
Sep 04 16:09:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:05 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2deba72c-ac57-4ed6-b1df-7657f3265d78 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.e24f89c1-ec5b-46f4-9bfe-3f695d660169" returned: 0 in 0.309s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:05 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-2deba72c-ac57-4ed6-b1df-7657f3265d78 tempest-ProjectMemberTests-369224070 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.e24f89c1-ec5b-46f4-9bfe-3f695d660169 is being set with open permissions: ugo+rw
Sep 04 16:09:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2deba72c-ac57-4ed6-b1df-7657f3265d78 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.e24f89c1-ec5b-46f4-9bfe-3f695d660169 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:05 devstack sudo[107784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.e24f89c1-ec5b-46f4-9bfe-3f695d660169
Sep 04 16:09:05 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:05 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2deba72c-ac57-4ed6-b1df-7657f3265d78 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.e24f89c1-ec5b-46f4-9bfe-3f695d660169" returned: 0 in 0.242s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2deba72c-ac57-4ed6-b1df-7657f3265d78 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:06 devstack sudo[107787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.info
Sep 04 16:09:06 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:06 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2deba72c-ac57-4ed6-b1df-7657f3265d78 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.info" returned: 0 in 0.257s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:06 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-2deba72c-ac57-4ed6-b1df-7657f3265d78 tempest-ProjectMemberTests-369224070 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.info is being set with open permissions: ugo+rw
Sep 04 16:09:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2deba72c-ac57-4ed6-b1df-7657f3265d78 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:06 devstack sudo[107790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.info
Sep 04 16:09:06 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:06 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2deba72c-ac57-4ed6-b1df-7657f3265d78 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.info" returned: 0 in 0.233s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2deba72c-ac57-4ed6-b1df-7657f3265d78 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.960s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.282s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1482709251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d48155f8-834e-4435-9934-0bfbccd2edfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07bb09d5823f43dca188c4caaa4b5480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:03Z,use_quota=True,user_id='0b76e0f6fc0e44b7bec703b6fd64ec59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:09:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Creating volume d48155f8-834e-4435-9934-0bfbccd2edfe {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:09:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:09:06 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:09:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:06 devstack sudo[107793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe 1073741824
Sep 04 16:09:06 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:06 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-2deba72c-ac57-4ed6-b1df-7657f3265d78 tempest-ProjectMemberTests-369224070 None] Create snapshot completed successfully
Sep 04 16:09:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-81447a52-f278-446d-a7c4-3433c073e2a9 tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-e24f89c1-ec5b-46f4-9bfe-3f695d660169-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-81447a52-f278-446d-a7c4-3433c073e2a9 tempest-ProjectMemberTests-369224070 None] Lock "cinder-e24f89c1-ec5b-46f4-9bfe-3f695d660169-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-81447a52-f278-446d-a7c4-3433c073e2a9 tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-a0f6d366-b06c-4e76-8a48-1a86d58c33a3" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-81447a52-f278-446d-a7c4-3433c073e2a9 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-a0f6d366-b06c-4e76-8a48-1a86d58c33a3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-81447a52-f278-446d-a7c4-3433c073e2a9 tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-e24f89c1-ec5b-46f4-9bfe-3f695d660169" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-81447a52-f278-446d-a7c4-3433c073e2a9 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-e24f89c1-ec5b-46f4-9bfe-3f695d660169" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-81447a52-f278-446d-a7c4-3433c073e2a9 tempest-ProjectMemberTests-369224070 None] Deleting offline snapshot e24f89c1-ec5b-46f4-9bfe-3f695d660169 of volume a0f6d366-b06c-4e76-8a48-1a86d58c33a3 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 16:09:06 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:06 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-81447a52-f278-446d-a7c4-3433c073e2a9 tempest-ProjectMemberTests-369224070 None] snapshot_file for this snap is: volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.e24f89c1-ec5b-46f4-9bfe-3f695d660169 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 16:09:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe 1073741824" returned: 0 in 0.473s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[be82cff9-3b96-4ca8-a255-1311cdcc75f0]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81447a52-f278-446d-a7c4-3433c073e2a9 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.e24f89c1-ec5b-46f4-9bfe-3f695d660169 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:07 devstack sudo[107800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe
Sep 04 16:09:07 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:07 devstack sudo[107799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.e24f89c1-ec5b-46f4-9bfe-3f695d660169
Sep 04 16:09:07 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:07 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe" returned: 0 in 0.262s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.808s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Acquiring lock "cinder-quobyte-dc985770-207a-45c5-8a52-d5bf6fae8ac9-9b7d72b9-391e-49ea-8d32-a926ac103826" by "_create_volume_from_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ef73e1e-e0ef-42f8-90ae-6d8b19a62c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d48155f8-834e-4435-9934-0bfbccd2edfe', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba6744b9-50cf-4e7d-ac6c-b73818adec3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Lock "cinder-quobyte-dc985770-207a-45c5-8a52-d5bf6fae8ac9-9b7d72b9-391e-49ea-8d32-a926ac103826" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Creating volume 9b7d72b9-391e-49ea-8d32-a926ac103826 from snapshot dc985770-207a-45c5-8a52-d5bf6fae8ac9 {{(pid=87504) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Acquiring lock "cinder-quobyte-9b7d72b9-391e-49ea-8d32-a926ac103826" by "_copy_volume_from_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Lock "cinder-quobyte-9b7d72b9-391e-49ea-8d32-a926ac103826" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] snapshot: dc985770-207a-45c5-8a52-d5bf6fae8ac9, volume: 9b7d72b9-391e-49ea-8d32-a926ac103826,  {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 04 16:09:07 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Volume volume-d48155f8-834e-4435-9934-0bfbccd2edfe (d48155f8-834e-4435-9934-0bfbccd2edfe): created successfully
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba6744b9-50cf-4e7d-ac6c-b73818adec3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:07 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Flow 'volume_create_manager' (0e2e7aa0-aae9-44cb-b2d3-6b1009ffe4b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81447a52-f278-446d-a7c4-3433c073e2a9 tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.e24f89c1-ec5b-46f4-9bfe-3f695d660169" returned: 0 in 0.409s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-81447a52-f278-446d-a7c4-3433c073e2a9 tempest-ProjectMemberTests-369224070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66397ad-9b0a-4c96-bf79-329330ee46e3]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81447a52-f278-446d-a7c4-3433c073e2a9 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6d3e05-7ad6-4e36-abe9-8a59e8255ed8]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:07 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-49f4a2ab-3b11-4c4d-9bd1-218f1b146680 tempest-ProjectReaderTests-1922078704 None] Created volume successfully.
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.dc985770-207a-45c5-8a52-d5bf6fae8ac9 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:07 devstack sudo[107807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3
Sep 04 16:09:07 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:07 devstack sudo[107808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.dc985770-207a-45c5-8a52-d5bf6fae8ac9
Sep 04 16:09:07 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:07 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81447a52-f278-446d-a7c4-3433c073e2a9 tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3" returned: 0 in 0.382s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81447a52-f278-446d-a7c4-3433c073e2a9 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.e24f89c1-ec5b-46f4-9bfe-3f695d660169 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:07 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.dc985770-207a-45c5-8a52-d5bf6fae8ac9" returned: 0 in 0.377s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3566c238-2b55-4ec9-989c-2cf7e63b311f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1914f2-7a13-4d88-91e6-eddbb17d4515]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:07 devstack sudo[107817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.e24f89c1-ec5b-46f4-9bfe-3f695d660169
Sep 04 16:09:07 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:07 devstack sudo[107819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f
Sep 04 16:09:07 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:08 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81447a52-f278-446d-a7c4-3433c073e2a9 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.e24f89c1-ec5b-46f4-9bfe-3f695d660169" returned: 0 in 0.320s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81447a52-f278-446d-a7c4-3433c073e2a9 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.e24f89c1-ec5b-46f4-9bfe-3f695d660169 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:08 devstack sudo[107826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.e24f89c1-ec5b-46f4-9bfe-3f695d660169
Sep 04 16:09:08 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:08 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f" returned: 0 in 0.368s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 04 16:09:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Creating direct copy from snapshot {{(pid=87504) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 04 16:09:08 devstack cinder-volume[87504]: DEBUG cinder.utils [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Path /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b7d72b9-391e-49ea-8d32-a926ac103826 not found in is_blk_device check {{(pid=87504) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 04 16:09:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b7d72b9-391e-49ea-8d32-a926ac103826 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:08 devstack sudo[107829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b7d72b9-391e-49ea-8d32-a926ac103826
Sep 04 16:09:08 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:08 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-81447a52-f278-446d-a7c4-3433c073e2a9 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3.e24f89c1-ec5b-46f4-9bfe-3f695d660169" returned: 0 in 0.273s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:08 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-81447a52-f278-446d-a7c4-3433c073e2a9 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-e24f89c1-ec5b-46f4-9bfe-3f695d660169" released by "_delete_snapshot" :: held 1.530s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:08 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-81447a52-f278-446d-a7c4-3433c073e2a9 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-a0f6d366-b06c-4e76-8a48-1a86d58c33a3" released by "delete_snapshot" :: held 1.564s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:08 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-81447a52-f278-446d-a7c4-3433c073e2a9 tempest-ProjectMemberTests-369224070 None] Created reservations ['b64372d3-4385-4b04-aefa-48dc0afc177e', '5782c056-9c90-4110-9248-3ca05e37318c', 'ac332231-3ef4-478e-b0c1-4a1e21aae75b', 'fbf6bdbb-2600-40b6-8d73-83640a93930b'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:09:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e486f62e-456a-4340-bbc9-d3e321a84321 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:08 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-81447a52-f278-446d-a7c4-3433c073e2a9 tempest-ProjectMemberTests-369224070 None] Delete snapshot completed successfully.
Sep 04 16:09:08 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-81447a52-f278-446d-a7c4-3433c073e2a9 tempest-ProjectMemberTests-369224070 None] Lock "cinder-e24f89c1-ec5b-46f4-9bfe-3f695d660169-delete_snapshot" released by "delete_snapshot" :: held 1.758s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:09 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-84252664-ee9a-4cba-b2a3-6de57800a01d tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-a0f6d366-b06c-4e76-8a48-1a86d58c33a3-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:09 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-84252664-ee9a-4cba-b2a3-6de57800a01d tempest-ProjectMemberTests-369224070 None] Lock "cinder-a0f6d366-b06c-4e76-8a48-1a86d58c33a3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:09 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-84252664-ee9a-4cba-b2a3-6de57800a01d tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-a0f6d366-b06c-4e76-8a48-1a86d58c33a3" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:09 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-84252664-ee9a-4cba-b2a3-6de57800a01d tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-a0f6d366-b06c-4e76-8a48-1a86d58c33a3" acquired by "delete_volume" :: waited 0.024s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:09 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b0a9e0-ebb1-4ed4-b954-940980e03c7b]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-84252664-ee9a-4cba-b2a3-6de57800a01d tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:09 devstack sudo[107842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3
Sep 04 16:09:09 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:10 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-84252664-ee9a-4cba-b2a3-6de57800a01d tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3" returned: 0 in 0.744s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-84252664-ee9a-4cba-b2a3-6de57800a01d tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:10 devstack sudo[107882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3
Sep 04 16:09:10 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:10 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-84252664-ee9a-4cba-b2a3-6de57800a01d tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a0f6d366-b06c-4e76-8a48-1a86d58c33a3" returned: 0 in 0.614s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:10 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-84252664-ee9a-4cba-b2a3-6de57800a01d tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-a0f6d366-b06c-4e76-8a48-1a86d58c33a3" released by "delete_volume" :: held 1.538s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:11 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-84252664-ee9a-4cba-b2a3-6de57800a01d tempest-ProjectMemberTests-369224070 None] Created reservations ['06997ada-b691-4a5f-b681-e41eb39d3f4c', 'f30fc0cc-1ff9-4fec-920e-04e014c5ed35', '3bada2c2-2fa3-4c48-9618-dbd680a61b00', '120aacd9-9f56-477f-9a5a-f1fd4e0d1f26'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:09:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-84252664-ee9a-4cba-b2a3-6de57800a01d tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-84252664-ee9a-4cba-b2a3-6de57800a01d tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-84252664-ee9a-4cba-b2a3-6de57800a01d tempest-ProjectMemberTests-369224070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:11 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-84252664-ee9a-4cba-b2a3-6de57800a01d tempest-ProjectMemberTests-369224070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-84252664-ee9a-4cba-b2a3-6de57800a01d tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-84252664-ee9a-4cba-b2a3-6de57800a01d tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:11 devstack sudo[107885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:09:11 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:12 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-84252664-ee9a-4cba-b2a3-6de57800a01d tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.792s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:12 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-84252664-ee9a-4cba-b2a3-6de57800a01d tempest-ProjectMemberTests-369224070 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:09:12 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-84252664-ee9a-4cba-b2a3-6de57800a01d tempest-ProjectMemberTests-369224070 None] Deleted volume successfully.
Sep 04 16:09:12 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-84252664-ee9a-4cba-b2a3-6de57800a01d tempest-ProjectMemberTests-369224070 None] Lock "cinder-a0f6d366-b06c-4e76-8a48-1a86d58c33a3-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:09:13 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Flow 'volume_create_manager' (efa009bc-ce0e-4730-8d83-ee3ab2850c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c600d947-63a2-4463-bef7-b7c3e3ea7cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b7d72b9-391e-49ea-8d32-a926ac103826" returned: 0 in 4.950s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG cinder.image.image_utils [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f, size 1024.00 MB, duration 4.95 sec, destination /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b7d72b9-391e-49ea-8d32-a926ac103826 {{(pid=87504) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 16:09:13 devstack cinder-volume[87504]: INFO cinder.image.image_utils [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Converted 1024.00 MB image at 206.82 MB/s
Sep 04 16:09:13 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b7d72b9-391e-49ea-8d32-a926ac103826 is being set with open permissions: ugo+rw
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b7d72b9-391e-49ea-8d32-a926ac103826 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:13 devstack sudo[107890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b7d72b9-391e-49ea-8d32-a926ac103826
Sep 04 16:09:13 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c600d947-63a2-4463-bef7-b7c3e3ea7cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1107193372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d11b38e4-e3be-4298-b768-45bc35e6214d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3bec3eae6a463fbbef6576bb85077b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:13Z,use_quota=True,user_id='fccb6cabb20d46fa8276df523be9732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae81c58-7b5d-4c16-8a82-93d96a61e074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae81c58-7b5d-4c16-8a82-93d96a61e074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99be328-70c9-46f9-825c-56c868410417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99be328-70c9-46f9-825c-56c868410417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd11b38e4-e3be-4298-b768-45bc35e6214d', 'volume_name': 'volume-d11b38e4-e3be-4298-b768-45bc35e6214d', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c533138-5f41-4821-8e9c-703a263ef5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c533138-5f41-4821-8e9c-703a263ef5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (893b2fcd-56b9-4797-8985-0cc1ca00b8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:13 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Volume d11b38e4-e3be-4298-b768-45bc35e6214d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d11b38e4-e3be-4298-b768-45bc35e6214d', 'volume_size': 1}
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:13 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b7d72b9-391e-49ea-8d32-a926ac103826" returned: 0 in 0.238s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Lock "cinder-quobyte-9b7d72b9-391e-49ea-8d32-a926ac103826" released by "_copy_volume_from_snapshot" :: held 6.056s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Lock "cinder-quobyte-dc985770-207a-45c5-8a52-d5bf6fae8ac9-9b7d72b9-391e-49ea-8d32-a926ac103826" released by "_create_volume_from_snapshot" :: held 6.118s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.160s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e486f62e-456a-4340-bbc9-d3e321a84321 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.838s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-e486f62e-456a-4340-bbc9-d3e321a84321 tempest-ProjectReaderTests-1922078704 None] Creating offline snapshot fc74390e-a498-414b-a8ea-c9140d2832d8 of volume d48155f8-834e-4435-9934-0bfbccd2edfe {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf8e606-9214-4a89-a00b-7d37cdcdd224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b7d72b9-391e-49ea-8d32-a926ac103826', 'volume_size': 1, 'snapshot_id': 'dc985770-207a-45c5-8a52-d5bf6fae8ac9'}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbda255c-f9db-42f4-a750-bfa0ccca2e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7d7ac2-2446-47e9-a453-97ffbb82477e]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e486f62e-456a-4340-bbc9-d3e321a84321 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:13 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Volume volume-9b7d72b9-391e-49ea-8d32-a926ac103826 (9b7d72b9-391e-49ea-8d32-a926ac103826): created successfully
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbda255c-f9db-42f4-a750-bfa0ccca2e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Flow 'volume_create_manager' (0cca33fc-921d-4111-94e5-55e6a0f1620b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:13 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-2307973d-85e3-465a-94a7-8ae21d47c291 tempest-SnapshotDependencyTests-2114230018 None] Created volume successfully.
Sep 04 16:09:13 devstack sudo[107893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe
Sep 04 16:09:13 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:13 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e486f62e-456a-4340-bbc9-d3e321a84321 tempest-ProjectReaderTests-1922078704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe" returned: 0 in 0.348s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e486f62e-456a-4340-bbc9-d3e321a84321 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.fc74390e-a498-414b-a8ea-c9140d2832d8 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:13 devstack sudo[107898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.fc74390e-a498-414b-a8ea-c9140d2832d8 1G
Sep 04 16:09:13 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4210714a-5999-45a7-8569-7b750d84a5d4 tempest-SnapshotDependencyTests-2114230018 None] Acquiring lock "cinder-dc985770-207a-45c5-8a52-d5bf6fae8ac9-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4210714a-5999-45a7-8569-7b750d84a5d4 tempest-SnapshotDependencyTests-2114230018 None] Lock "cinder-dc985770-207a-45c5-8a52-d5bf6fae8ac9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4210714a-5999-45a7-8569-7b750d84a5d4 tempest-SnapshotDependencyTests-2114230018 None] Acquiring lock "cinder-quobyte-3566c238-2b55-4ec9-989c-2cf7e63b311f" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4210714a-5999-45a7-8569-7b750d84a5d4 tempest-SnapshotDependencyTests-2114230018 None] Lock "cinder-quobyte-3566c238-2b55-4ec9-989c-2cf7e63b311f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4210714a-5999-45a7-8569-7b750d84a5d4 tempest-SnapshotDependencyTests-2114230018 None] Acquiring lock "cinder-quobyte-dc985770-207a-45c5-8a52-d5bf6fae8ac9" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:14 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4210714a-5999-45a7-8569-7b750d84a5d4 tempest-SnapshotDependencyTests-2114230018 None] Lock "cinder-quobyte-dc985770-207a-45c5-8a52-d5bf6fae8ac9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:14 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-4210714a-5999-45a7-8569-7b750d84a5d4 tempest-SnapshotDependencyTests-2114230018 None] Deleting offline snapshot dc985770-207a-45c5-8a52-d5bf6fae8ac9 of volume 3566c238-2b55-4ec9-989c-2cf7e63b311f {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 16:09:14 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-4210714a-5999-45a7-8569-7b750d84a5d4 tempest-SnapshotDependencyTests-2114230018 None] snapshot_file for this snap is: volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.dc985770-207a-45c5-8a52-d5bf6fae8ac9 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 16:09:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e486f62e-456a-4340-bbc9-d3e321a84321 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.fc74390e-a498-414b-a8ea-c9140d2832d8 1G" returned: 0 in 0.424s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e486f62e-456a-4340-bbc9-d3e321a84321 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d48155f8-834e-4435-9934-0bfbccd2edfe -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.fc74390e-a498-414b-a8ea-c9140d2832d8 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:14 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76b04a2-7787-4032-90b4-4e0d7389bffe]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4210714a-5999-45a7-8569-7b750d84a5d4 tempest-SnapshotDependencyTests-2114230018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.dc985770-207a-45c5-8a52-d5bf6fae8ac9 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:14 devstack sudo[107904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d48155f8-834e-4435-9934-0bfbccd2edfe -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.fc74390e-a498-414b-a8ea-c9140d2832d8
Sep 04 16:09:14 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:14 devstack sudo[107905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.dc985770-207a-45c5-8a52-d5bf6fae8ac9
Sep 04 16:09:14 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:14 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e486f62e-456a-4340-bbc9-d3e321a84321 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d48155f8-834e-4435-9934-0bfbccd2edfe -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.fc74390e-a498-414b-a8ea-c9140d2832d8" returned: 0 in 0.301s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:14 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-e486f62e-456a-4340-bbc9-d3e321a84321 tempest-ProjectReaderTests-1922078704 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.fc74390e-a498-414b-a8ea-c9140d2832d8 is being set with open permissions: ugo+rw
Sep 04 16:09:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e486f62e-456a-4340-bbc9-d3e321a84321 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.fc74390e-a498-414b-a8ea-c9140d2832d8 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:14 devstack sudo[107913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.fc74390e-a498-414b-a8ea-c9140d2832d8
Sep 04 16:09:14 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:14 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4210714a-5999-45a7-8569-7b750d84a5d4 tempest-SnapshotDependencyTests-2114230018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.dc985770-207a-45c5-8a52-d5bf6fae8ac9" returned: 0 in 0.356s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:14 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-4210714a-5999-45a7-8569-7b750d84a5d4 tempest-SnapshotDependencyTests-2114230018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3566c238-2b55-4ec9-989c-2cf7e63b311f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:09:14 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad57107c-ca53-49d8-b26d-be3efef13343]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4210714a-5999-45a7-8569-7b750d84a5d4 tempest-SnapshotDependencyTests-2114230018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:14 devstack sudo[107917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f
Sep 04 16:09:14 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:14 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e486f62e-456a-4340-bbc9-d3e321a84321 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.fc74390e-a498-414b-a8ea-c9140d2832d8" returned: 0 in 0.251s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e486f62e-456a-4340-bbc9-d3e321a84321 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:14 devstack sudo[107920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.info
Sep 04 16:09:14 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:15 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e486f62e-456a-4340-bbc9-d3e321a84321 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.info" returned: 0 in 0.265s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:15 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-e486f62e-456a-4340-bbc9-d3e321a84321 tempest-ProjectReaderTests-1922078704 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.info is being set with open permissions: ugo+rw
Sep 04 16:09:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e486f62e-456a-4340-bbc9-d3e321a84321 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:15 devstack sudo[107925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.info
Sep 04 16:09:15 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:15 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4210714a-5999-45a7-8569-7b750d84a5d4 tempest-SnapshotDependencyTests-2114230018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f" returned: 0 in 0.533s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4210714a-5999-45a7-8569-7b750d84a5d4 tempest-SnapshotDependencyTests-2114230018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.dc985770-207a-45c5-8a52-d5bf6fae8ac9 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:15 devstack sudo[107928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.dc985770-207a-45c5-8a52-d5bf6fae8ac9
Sep 04 16:09:15 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:15 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-e486f62e-456a-4340-bbc9-d3e321a84321 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.info" returned: 0 in 0.261s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-e486f62e-456a-4340-bbc9-d3e321a84321 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.942s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.171s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:15 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1107193372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d11b38e4-e3be-4298-b768-45bc35e6214d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3bec3eae6a463fbbef6576bb85077b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:13Z,use_quota=True,user_id='fccb6cabb20d46fa8276df523be9732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:09:15 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Creating volume d11b38e4-e3be-4298-b768-45bc35e6214d {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:09:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:15 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:15 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:15 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:09:15 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:09:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:15 devstack sudo[107932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d 1073741824
Sep 04 16:09:15 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:15 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-e486f62e-456a-4340-bbc9-d3e321a84321 tempest-ProjectReaderTests-1922078704 None] Create snapshot completed successfully
Sep 04 16:09:15 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4210714a-5999-45a7-8569-7b750d84a5d4 tempest-SnapshotDependencyTests-2114230018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.dc985770-207a-45c5-8a52-d5bf6fae8ac9" returned: 0 in 0.374s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4210714a-5999-45a7-8569-7b750d84a5d4 tempest-SnapshotDependencyTests-2114230018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.dc985770-207a-45c5-8a52-d5bf6fae8ac9 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:15 devstack sudo[107936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.dc985770-207a-45c5-8a52-d5bf6fae8ac9
Sep 04 16:09:15 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:15 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4210714a-5999-45a7-8569-7b750d84a5d4 tempest-SnapshotDependencyTests-2114230018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f.dc985770-207a-45c5-8a52-d5bf6fae8ac9" returned: 0 in 0.266s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:15 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d 1073741824" returned: 0 in 0.444s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4210714a-5999-45a7-8569-7b750d84a5d4 tempest-SnapshotDependencyTests-2114230018 None] Lock "cinder-quobyte-dc985770-207a-45c5-8a52-d5bf6fae8ac9" released by "_delete_snapshot" :: held 1.635s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4210714a-5999-45a7-8569-7b750d84a5d4 tempest-SnapshotDependencyTests-2114230018 None] Lock "cinder-quobyte-3566c238-2b55-4ec9-989c-2cf7e63b311f" released by "delete_snapshot" :: held 1.660s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:15 devstack sudo[107942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d
Sep 04 16:09:15 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-4210714a-5999-45a7-8569-7b750d84a5d4 tempest-SnapshotDependencyTests-2114230018 None] Created reservations ['503ed56f-ae00-41b9-8721-70379780a7f8', '3df51bcd-da6a-4bf8-be0d-99ad980d0a47', '0e459042-056e-4003-a6be-c7263d01210f', 'e8079255-29a9-47a8-a3bd-feae05eb9bc2'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:09:16 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-4210714a-5999-45a7-8569-7b750d84a5d4 tempest-SnapshotDependencyTests-2114230018 None] Delete snapshot completed successfully.
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4210714a-5999-45a7-8569-7b750d84a5d4 tempest-SnapshotDependencyTests-2114230018 None] Lock "cinder-dc985770-207a-45c5-8a52-d5bf6fae8ac9-delete_snapshot" released by "delete_snapshot" :: held 1.843s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-af75340b-b4b1-44af-8986-2eb52d3f0708 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "cinder-fc74390e-a498-414b-a8ea-c9140d2832d8-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-af75340b-b4b1-44af-8986-2eb52d3f0708 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-fc74390e-a498-414b-a8ea-c9140d2832d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-af75340b-b4b1-44af-8986-2eb52d3f0708 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "cinder-quobyte-d48155f8-834e-4435-9934-0bfbccd2edfe" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:16 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d" returned: 0 in 0.270s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (893b2fcd-56b9-4797-8985-0cc1ca00b8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d11b38e4-e3be-4298-b768-45bc35e6214d', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a53ef7d1-9d2f-4cbc-ad1b-9577d881e013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-af75340b-b4b1-44af-8986-2eb52d3f0708 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-d48155f8-834e-4435-9934-0bfbccd2edfe" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-af75340b-b4b1-44af-8986-2eb52d3f0708 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "cinder-quobyte-fc74390e-a498-414b-a8ea-c9140d2832d8" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:16 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Volume volume-d11b38e4-e3be-4298-b768-45bc35e6214d (d11b38e4-e3be-4298-b768-45bc35e6214d): created successfully
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a53ef7d1-9d2f-4cbc-ad1b-9577d881e013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Flow 'volume_create_manager' (efa009bc-ce0e-4730-8d83-ee3ab2850c17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-af75340b-b4b1-44af-8986-2eb52d3f0708 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-fc74390e-a498-414b-a8ea-c9140d2832d8" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-af75340b-b4b1-44af-8986-2eb52d3f0708 tempest-ProjectReaderTests-1922078704 None] Deleting offline snapshot fc74390e-a498-414b-a8ea-c9140d2832d8 of volume d48155f8-834e-4435-9934-0bfbccd2edfe {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-af75340b-b4b1-44af-8986-2eb52d3f0708 tempest-ProjectReaderTests-1922078704 None] snapshot_file for this snap is: volume-d48155f8-834e-4435-9934-0bfbccd2edfe.fc74390e-a498-414b-a8ea-c9140d2832d8 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 16:09:16 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-c23c5ebd-5a8a-4a70-803e-fe54d0e99310 tempest-ProjectMemberTests-369224070 None] Created volume successfully.
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a22f347-0597-40ba-b70e-44a27a6aafb2]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-af75340b-b4b1-44af-8986-2eb52d3f0708 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.fc74390e-a498-414b-a8ea-c9140d2832d8 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1fe70096-9df7-44c7-97eb-6bc5d9ab4d56 tempest-SnapshotDependencyTests-2114230018 None] Acquiring lock "cinder-3566c238-2b55-4ec9-989c-2cf7e63b311f-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1fe70096-9df7-44c7-97eb-6bc5d9ab4d56 tempest-SnapshotDependencyTests-2114230018 None] Lock "cinder-3566c238-2b55-4ec9-989c-2cf7e63b311f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:16 devstack sudo[107945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.fc74390e-a498-414b-a8ea-c9140d2832d8
Sep 04 16:09:16 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1fe70096-9df7-44c7-97eb-6bc5d9ab4d56 tempest-SnapshotDependencyTests-2114230018 None] Acquiring lock "cinder-quobyte-3566c238-2b55-4ec9-989c-2cf7e63b311f" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1fe70096-9df7-44c7-97eb-6bc5d9ab4d56 tempest-SnapshotDependencyTests-2114230018 None] Lock "cinder-quobyte-3566c238-2b55-4ec9-989c-2cf7e63b311f" acquired by "delete_volume" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b319f8-e52d-47eb-8927-31b0c92f55ee]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1fe70096-9df7-44c7-97eb-6bc5d9ab4d56 tempest-SnapshotDependencyTests-2114230018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:16 devstack sudo[107947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f
Sep 04 16:09:16 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:16 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-af75340b-b4b1-44af-8986-2eb52d3f0708 tempest-ProjectReaderTests-1922078704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.fc74390e-a498-414b-a8ea-c9140d2832d8" returned: 0 in 0.386s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-af75340b-b4b1-44af-8986-2eb52d3f0708 tempest-ProjectReaderTests-1922078704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d48155f8-834e-4435-9934-0bfbccd2edfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1239859-cdb6-4b78-b934-f3a3eec97dc2]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-af75340b-b4b1-44af-8986-2eb52d3f0708 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:16 devstack sudo[107952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe
Sep 04 16:09:16 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:16 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1fe70096-9df7-44c7-97eb-6bc5d9ab4d56 tempest-SnapshotDependencyTests-2114230018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f" returned: 0 in 0.413s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1fe70096-9df7-44c7-97eb-6bc5d9ab4d56 tempest-SnapshotDependencyTests-2114230018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:16 devstack sudo[107957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f
Sep 04 16:09:16 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:17 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-af75340b-b4b1-44af-8986-2eb52d3f0708 tempest-ProjectReaderTests-1922078704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe" returned: 0 in 0.399s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-af75340b-b4b1-44af-8986-2eb52d3f0708 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.fc74390e-a498-414b-a8ea-c9140d2832d8 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:17 devstack sudo[107962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.fc74390e-a498-414b-a8ea-c9140d2832d8
Sep 04 16:09:17 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:17 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1fe70096-9df7-44c7-97eb-6bc5d9ab4d56 tempest-SnapshotDependencyTests-2114230018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-3566c238-2b55-4ec9-989c-2cf7e63b311f" returned: 0 in 0.298s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1fe70096-9df7-44c7-97eb-6bc5d9ab4d56 tempest-SnapshotDependencyTests-2114230018 None] Lock "cinder-quobyte-3566c238-2b55-4ec9-989c-2cf7e63b311f" released by "delete_volume" :: held 0.786s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-1fe70096-9df7-44c7-97eb-6bc5d9ab4d56 tempest-SnapshotDependencyTests-2114230018 None] Created reservations ['37e470a1-e85c-40a7-8906-0deff48bfec3', '51951007-4a0a-4e2a-b486-983176ff4f4d', '7fb03c41-08ce-4158-80d3-5cbd77b9fb93', '93823941-f1c9-43c8-b74d-29723841c0cb'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cc49b525-bbac-4dba-a64d-78ab70ab2df8 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cc49b525-bbac-4dba-a64d-78ab70ab2df8 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-cc49b525-bbac-4dba-a64d-78ab70ab2df8 tempest-ProjectMemberTests-369224070 None] Creating offline snapshot d65d8319-df63-4642-8bb1-556f7c4e6e47 of volume d11b38e4-e3be-4298-b768-45bc35e6214d {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1fe70096-9df7-44c7-97eb-6bc5d9ab4d56 tempest-SnapshotDependencyTests-2114230018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1fe70096-9df7-44c7-97eb-6bc5d9ab4d56 tempest-SnapshotDependencyTests-2114230018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1fe70096-9df7-44c7-97eb-6bc5d9ab4d56 tempest-SnapshotDependencyTests-2114230018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-1fe70096-9df7-44c7-97eb-6bc5d9ab4d56 tempest-SnapshotDependencyTests-2114230018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-1fe70096-9df7-44c7-97eb-6bc5d9ab4d56 tempest-SnapshotDependencyTests-2114230018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1fe70096-9df7-44c7-97eb-6bc5d9ab4d56 tempest-SnapshotDependencyTests-2114230018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[11835613-25ab-4736-b21c-9c5e00c01f10]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cc49b525-bbac-4dba-a64d-78ab70ab2df8 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:17 devstack sudo[107969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:09:17 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:17 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-af75340b-b4b1-44af-8986-2eb52d3f0708 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.fc74390e-a498-414b-a8ea-c9140d2832d8" returned: 0 in 0.405s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-af75340b-b4b1-44af-8986-2eb52d3f0708 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.fc74390e-a498-414b-a8ea-c9140d2832d8 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:17 devstack sudo[107972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.fc74390e-a498-414b-a8ea-c9140d2832d8
Sep 04 16:09:17 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-069cb547-d9aa-4774-8779-57c46991f0f8 tempest-SnapshotDependencyTests-2114230018 None] Acquiring lock "cinder-9b7d72b9-391e-49ea-8d32-a926ac103826-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-069cb547-d9aa-4774-8779-57c46991f0f8 tempest-SnapshotDependencyTests-2114230018 None] Lock "cinder-9b7d72b9-391e-49ea-8d32-a926ac103826-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:17 devstack sudo[107970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d
Sep 04 16:09:17 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-069cb547-d9aa-4774-8779-57c46991f0f8 tempest-SnapshotDependencyTests-2114230018 None] Acquiring lock "cinder-quobyte-9b7d72b9-391e-49ea-8d32-a926ac103826" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-069cb547-d9aa-4774-8779-57c46991f0f8 tempest-SnapshotDependencyTests-2114230018 None] Lock "cinder-quobyte-9b7d72b9-391e-49ea-8d32-a926ac103826" acquired by "delete_volume" :: waited 0.028s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9d8587-1281-4fa8-85db-5fb4639c3892]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-069cb547-d9aa-4774-8779-57c46991f0f8 tempest-SnapshotDependencyTests-2114230018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b7d72b9-391e-49ea-8d32-a926ac103826 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:17 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-1fe70096-9df7-44c7-97eb-6bc5d9ab4d56 tempest-SnapshotDependencyTests-2114230018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.349s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-1fe70096-9df7-44c7-97eb-6bc5d9ab4d56 tempest-SnapshotDependencyTests-2114230018 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:09:17 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-1fe70096-9df7-44c7-97eb-6bc5d9ab4d56 tempest-SnapshotDependencyTests-2114230018 None] Deleted volume successfully.
Sep 04 16:09:17 devstack sudo[107975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b7d72b9-391e-49ea-8d32-a926ac103826
Sep 04 16:09:17 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-1fe70096-9df7-44c7-97eb-6bc5d9ab4d56 tempest-SnapshotDependencyTests-2114230018 None] Lock "cinder-3566c238-2b55-4ec9-989c-2cf7e63b311f-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:17 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-af75340b-b4b1-44af-8986-2eb52d3f0708 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe.fc74390e-a498-414b-a8ea-c9140d2832d8" returned: 0 in 0.384s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-af75340b-b4b1-44af-8986-2eb52d3f0708 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-fc74390e-a498-414b-a8ea-c9140d2832d8" released by "_delete_snapshot" :: held 1.675s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:17 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-af75340b-b4b1-44af-8986-2eb52d3f0708 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-d48155f8-834e-4435-9934-0bfbccd2edfe" released by "delete_snapshot" :: held 1.716s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:17 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cc49b525-bbac-4dba-a64d-78ab70ab2df8 tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d" returned: 0 in 0.496s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cc49b525-bbac-4dba-a64d-78ab70ab2df8 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.d65d8319-df63-4642-8bb1-556f7c4e6e47 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:18 devstack sudo[107982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.d65d8319-df63-4642-8bb1-556f7c4e6e47 1G
Sep 04 16:09:18 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-af75340b-b4b1-44af-8986-2eb52d3f0708 tempest-ProjectReaderTests-1922078704 None] Created reservations ['045e9547-6513-4f15-b231-12423bd5a8f3', '3269adbe-a74b-42e3-b186-cef3e0116dcd', '0cbae6d8-f662-4ce6-a588-674c6ca2ac1a', 'c54f6c12-81f8-4c47-980e-5647bc721eb5'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:09:18 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-af75340b-b4b1-44af-8986-2eb52d3f0708 tempest-ProjectReaderTests-1922078704 None] Delete snapshot completed successfully.
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-af75340b-b4b1-44af-8986-2eb52d3f0708 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-fc74390e-a498-414b-a8ea-c9140d2832d8-delete_snapshot" released by "delete_snapshot" :: held 1.937s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:18 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-069cb547-d9aa-4774-8779-57c46991f0f8 tempest-SnapshotDependencyTests-2114230018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b7d72b9-391e-49ea-8d32-a926ac103826" returned: 0 in 0.455s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-069cb547-d9aa-4774-8779-57c46991f0f8 tempest-SnapshotDependencyTests-2114230018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b7d72b9-391e-49ea-8d32-a926ac103826 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:18 devstack sudo[107987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b7d72b9-391e-49ea-8d32-a926ac103826
Sep 04 16:09:18 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-97174d9f-101e-4961-a5d5-a2b857c97808 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "cinder-d48155f8-834e-4435-9934-0bfbccd2edfe-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-97174d9f-101e-4961-a5d5-a2b857c97808 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-d48155f8-834e-4435-9934-0bfbccd2edfe-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-97174d9f-101e-4961-a5d5-a2b857c97808 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "cinder-quobyte-d48155f8-834e-4435-9934-0bfbccd2edfe" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-97174d9f-101e-4961-a5d5-a2b857c97808 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-d48155f8-834e-4435-9934-0bfbccd2edfe" acquired by "delete_volume" :: waited 0.022s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6a6b34-7e7b-4b65-8b5a-a0409ce4a1d4]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-97174d9f-101e-4961-a5d5-a2b857c97808 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:18 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-069cb547-d9aa-4774-8779-57c46991f0f8 tempest-SnapshotDependencyTests-2114230018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9b7d72b9-391e-49ea-8d32-a926ac103826" returned: 0 in 0.362s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:18 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cc49b525-bbac-4dba-a64d-78ab70ab2df8 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.d65d8319-df63-4642-8bb1-556f7c4e6e47 1G" returned: 0 in 0.576s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cc49b525-bbac-4dba-a64d-78ab70ab2df8 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d11b38e4-e3be-4298-b768-45bc35e6214d -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.d65d8319-df63-4642-8bb1-556f7c4e6e47 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-069cb547-d9aa-4774-8779-57c46991f0f8 tempest-SnapshotDependencyTests-2114230018 None] Lock "cinder-quobyte-9b7d72b9-391e-49ea-8d32-a926ac103826" released by "delete_volume" :: held 0.877s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:18 devstack sudo[107995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d11b38e4-e3be-4298-b768-45bc35e6214d -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.d65d8319-df63-4642-8bb1-556f7c4e6e47
Sep 04 16:09:18 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:18 devstack sudo[107994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-069cb547-d9aa-4774-8779-57c46991f0f8 tempest-SnapshotDependencyTests-2114230018 None] Created reservations ['bbbed4de-d9c1-438c-88b0-24eaa316fefd', '1cf6c302-e43b-49bd-ad5c-490d7710a2a8', '837b40c4-1d8e-4d23-873f-d26b40cc9908', '607a2136-de18-4f2f-a2ab-274a69fb8dad'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:09:18 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-069cb547-d9aa-4774-8779-57c46991f0f8 tempest-SnapshotDependencyTests-2114230018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-069cb547-d9aa-4774-8779-57c46991f0f8 tempest-SnapshotDependencyTests-2114230018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-069cb547-d9aa-4774-8779-57c46991f0f8 tempest-SnapshotDependencyTests-2114230018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-069cb547-d9aa-4774-8779-57c46991f0f8 tempest-SnapshotDependencyTests-2114230018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-069cb547-d9aa-4774-8779-57c46991f0f8 tempest-SnapshotDependencyTests-2114230018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-069cb547-d9aa-4774-8779-57c46991f0f8 tempest-SnapshotDependencyTests-2114230018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:18 devstack sudo[107998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:09:18 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:18 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:18 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cc49b525-bbac-4dba-a64d-78ab70ab2df8 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d11b38e4-e3be-4298-b768-45bc35e6214d -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.d65d8319-df63-4642-8bb1-556f7c4e6e47" returned: 0 in 0.388s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-97174d9f-101e-4961-a5d5-a2b857c97808 tempest-ProjectReaderTests-1922078704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe" returned: 0 in 0.442s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:18 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-cc49b525-bbac-4dba-a64d-78ab70ab2df8 tempest-ProjectMemberTests-369224070 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.d65d8319-df63-4642-8bb1-556f7c4e6e47 is being set with open permissions: ugo+rw
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cc49b525-bbac-4dba-a64d-78ab70ab2df8 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.d65d8319-df63-4642-8bb1-556f7c4e6e47 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-97174d9f-101e-4961-a5d5-a2b857c97808 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:19 devstack sudo[108007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.d65d8319-df63-4642-8bb1-556f7c4e6e47
Sep 04 16:09:19 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:19 devstack sudo[108009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe
Sep 04 16:09:19 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:19 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-069cb547-d9aa-4774-8779-57c46991f0f8 tempest-SnapshotDependencyTests-2114230018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.294s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:19 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-069cb547-d9aa-4774-8779-57c46991f0f8 tempest-SnapshotDependencyTests-2114230018 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:09:19 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-069cb547-d9aa-4774-8779-57c46991f0f8 tempest-SnapshotDependencyTests-2114230018 None] Deleted volume successfully.
Sep 04 16:09:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-069cb547-d9aa-4774-8779-57c46991f0f8 tempest-SnapshotDependencyTests-2114230018 None] Lock "cinder-9b7d72b9-391e-49ea-8d32-a926ac103826-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:19 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:19 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cc49b525-bbac-4dba-a64d-78ab70ab2df8 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.d65d8319-df63-4642-8bb1-556f7c4e6e47" returned: 0 in 0.277s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-97174d9f-101e-4961-a5d5-a2b857c97808 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d48155f8-834e-4435-9934-0bfbccd2edfe" returned: 0 in 0.274s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-97174d9f-101e-4961-a5d5-a2b857c97808 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-quobyte-d48155f8-834e-4435-9934-0bfbccd2edfe" released by "delete_volume" :: held 0.789s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cc49b525-bbac-4dba-a64d-78ab70ab2df8 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:19 devstack sudo[108015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.info
Sep 04 16:09:19 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:19 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-97174d9f-101e-4961-a5d5-a2b857c97808 tempest-ProjectReaderTests-1922078704 None] Created reservations ['5ee6e892-c6db-468a-9e0a-3c65f5855206', 'b4b44b29-c793-4f64-bc68-d9bc26f210fb', 'ee0c6b6b-0295-40bf-8074-4e45d67e55a6', '08655d0f-f9cc-4281-8e87-19b014860a38'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:09:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-97174d9f-101e-4961-a5d5-a2b857c97808 tempest-ProjectReaderTests-1922078704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-97174d9f-101e-4961-a5d5-a2b857c97808 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:19 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-97174d9f-101e-4961-a5d5-a2b857c97808 tempest-ProjectReaderTests-1922078704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:19 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-97174d9f-101e-4961-a5d5-a2b857c97808 tempest-ProjectReaderTests-1922078704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-97174d9f-101e-4961-a5d5-a2b857c97808 tempest-ProjectReaderTests-1922078704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-97174d9f-101e-4961-a5d5-a2b857c97808 tempest-ProjectReaderTests-1922078704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:19 devstack sudo[108017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:09:19 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:19 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cc49b525-bbac-4dba-a64d-78ab70ab2df8 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.info" returned: 0 in 0.334s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:19 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-cc49b525-bbac-4dba-a64d-78ab70ab2df8 tempest-ProjectMemberTests-369224070 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.info is being set with open permissions: ugo+rw
Sep 04 16:09:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cc49b525-bbac-4dba-a64d-78ab70ab2df8 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:19 devstack sudo[108020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.info
Sep 04 16:09:19 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:19 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-97174d9f-101e-4961-a5d5-a2b857c97808 tempest-ProjectReaderTests-1922078704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.321s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:19 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-97174d9f-101e-4961-a5d5-a2b857c97808 tempest-ProjectReaderTests-1922078704 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:09:19 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-97174d9f-101e-4961-a5d5-a2b857c97808 tempest-ProjectReaderTests-1922078704 None] Deleted volume successfully.
Sep 04 16:09:19 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-97174d9f-101e-4961-a5d5-a2b857c97808 tempest-ProjectReaderTests-1922078704 None] Lock "cinder-d48155f8-834e-4435-9934-0bfbccd2edfe-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:19 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-cc49b525-bbac-4dba-a64d-78ab70ab2df8 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.info" returned: 0 in 0.328s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-cc49b525-bbac-4dba-a64d-78ab70ab2df8 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.549s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:20 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-cc49b525-bbac-4dba-a64d-78ab70ab2df8 tempest-ProjectMemberTests-369224070 None] Create snapshot completed successfully
Sep 04 16:09:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-85cfb256-08ac-49fd-96cc-f9f6bb760711 tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-d65d8319-df63-4642-8bb1-556f7c4e6e47-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-85cfb256-08ac-49fd-96cc-f9f6bb760711 tempest-ProjectMemberTests-369224070 None] Lock "cinder-d65d8319-df63-4642-8bb1-556f7c4e6e47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-85cfb256-08ac-49fd-96cc-f9f6bb760711 tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-d11b38e4-e3be-4298-b768-45bc35e6214d" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-85cfb256-08ac-49fd-96cc-f9f6bb760711 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-d11b38e4-e3be-4298-b768-45bc35e6214d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-85cfb256-08ac-49fd-96cc-f9f6bb760711 tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-d65d8319-df63-4642-8bb1-556f7c4e6e47" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-85cfb256-08ac-49fd-96cc-f9f6bb760711 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-d65d8319-df63-4642-8bb1-556f7c4e6e47" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-85cfb256-08ac-49fd-96cc-f9f6bb760711 tempest-ProjectMemberTests-369224070 None] Deleting offline snapshot d65d8319-df63-4642-8bb1-556f7c4e6e47 of volume d11b38e4-e3be-4298-b768-45bc35e6214d {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 16:09:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-85cfb256-08ac-49fd-96cc-f9f6bb760711 tempest-ProjectMemberTests-369224070 None] snapshot_file for this snap is: volume-d11b38e4-e3be-4298-b768-45bc35e6214d.d65d8319-df63-4642-8bb1-556f7c4e6e47 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 16:09:20 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4dbd15-ecc5-4c82-bde0-d63bd642e7fc]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-85cfb256-08ac-49fd-96cc-f9f6bb760711 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.d65d8319-df63-4642-8bb1-556f7c4e6e47 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:20 devstack sudo[108031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.d65d8319-df63-4642-8bb1-556f7c4e6e47
Sep 04 16:09:20 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:21 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-85cfb256-08ac-49fd-96cc-f9f6bb760711 tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.d65d8319-df63-4642-8bb1-556f7c4e6e47" returned: 0 in 0.440s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-85cfb256-08ac-49fd-96cc-f9f6bb760711 tempest-ProjectMemberTests-369224070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d11b38e4-e3be-4298-b768-45bc35e6214d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:09:21 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[989ed649-a28e-4f2b-a4e8-8fb18895ed51]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-85cfb256-08ac-49fd-96cc-f9f6bb760711 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:21 devstack sudo[108037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d
Sep 04 16:09:21 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:21 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-85cfb256-08ac-49fd-96cc-f9f6bb760711 tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d" returned: 0 in 0.455s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-85cfb256-08ac-49fd-96cc-f9f6bb760711 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.d65d8319-df63-4642-8bb1-556f7c4e6e47 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:21 devstack sudo[108044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.d65d8319-df63-4642-8bb1-556f7c4e6e47
Sep 04 16:09:21 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:22 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-85cfb256-08ac-49fd-96cc-f9f6bb760711 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.d65d8319-df63-4642-8bb1-556f7c4e6e47" returned: 0 in 0.426s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-85cfb256-08ac-49fd-96cc-f9f6bb760711 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.d65d8319-df63-4642-8bb1-556f7c4e6e47 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:22 devstack sudo[108050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.d65d8319-df63-4642-8bb1-556f7c4e6e47
Sep 04 16:09:22 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:22 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-85cfb256-08ac-49fd-96cc-f9f6bb760711 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d.d65d8319-df63-4642-8bb1-556f7c4e6e47" returned: 0 in 0.245s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-85cfb256-08ac-49fd-96cc-f9f6bb760711 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-d65d8319-df63-4642-8bb1-556f7c4e6e47" released by "_delete_snapshot" :: held 1.685s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-85cfb256-08ac-49fd-96cc-f9f6bb760711 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-d11b38e4-e3be-4298-b768-45bc35e6214d" released by "delete_snapshot" :: held 1.714s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:22 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-85cfb256-08ac-49fd-96cc-f9f6bb760711 tempest-ProjectMemberTests-369224070 None] Created reservations ['fff558bb-1935-4952-9de0-9168541c1312', '2457f9de-2731-4656-a1b9-753b96944e3d', '09b439c9-92b9-47d7-833a-9d25dfc35270', '77176b05-a3d8-4fab-9f46-18293e0501da'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:09:22 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-85cfb256-08ac-49fd-96cc-f9f6bb760711 tempest-ProjectMemberTests-369224070 None] Delete snapshot completed successfully.
Sep 04 16:09:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-85cfb256-08ac-49fd-96cc-f9f6bb760711 tempest-ProjectMemberTests-369224070 None] Lock "cinder-d65d8319-df63-4642-8bb1-556f7c4e6e47-delete_snapshot" released by "delete_snapshot" :: held 1.862s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4af76401-79b3-4260-b556-f3d2f48dc04d tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-d11b38e4-e3be-4298-b768-45bc35e6214d-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4af76401-79b3-4260-b556-f3d2f48dc04d tempest-ProjectMemberTests-369224070 None] Lock "cinder-d11b38e4-e3be-4298-b768-45bc35e6214d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4af76401-79b3-4260-b556-f3d2f48dc04d tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-d11b38e4-e3be-4298-b768-45bc35e6214d" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4af76401-79b3-4260-b556-f3d2f48dc04d tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-d11b38e4-e3be-4298-b768-45bc35e6214d" acquired by "delete_volume" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:23 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5f33d3-572f-447e-b17d-cefebf1624f1]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4af76401-79b3-4260-b556-f3d2f48dc04d tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:23 devstack sudo[108053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d
Sep 04 16:09:23 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:23 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4af76401-79b3-4260-b556-f3d2f48dc04d tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d" returned: 0 in 0.395s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4af76401-79b3-4260-b556-f3d2f48dc04d tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:23 devstack sudo[108058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d
Sep 04 16:09:23 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:23 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4af76401-79b3-4260-b556-f3d2f48dc04d tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d11b38e4-e3be-4298-b768-45bc35e6214d" returned: 0 in 0.316s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4af76401-79b3-4260-b556-f3d2f48dc04d tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-d11b38e4-e3be-4298-b768-45bc35e6214d" released by "delete_volume" :: held 0.805s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:23 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-4af76401-79b3-4260-b556-f3d2f48dc04d tempest-ProjectMemberTests-369224070 None] Created reservations ['4e4f097d-5c49-4acd-8d89-ba337b25f05d', '82b61440-62a3-4180-8494-514295a182bb', 'edc2beb8-11e0-4ca1-8393-295fffaa10bc', 'bbac1f90-d684-42eb-9c80-63d0cfe2f15e'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4af76401-79b3-4260-b556-f3d2f48dc04d tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4af76401-79b3-4260-b556-f3d2f48dc04d tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4af76401-79b3-4260-b556-f3d2f48dc04d tempest-ProjectMemberTests-369224070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-4af76401-79b3-4260-b556-f3d2f48dc04d tempest-ProjectMemberTests-369224070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-4af76401-79b3-4260-b556-f3d2f48dc04d tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4af76401-79b3-4260-b556-f3d2f48dc04d tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:24 devstack sudo[108062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:09:24 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:24 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-4af76401-79b3-4260-b556-f3d2f48dc04d tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.311s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-4af76401-79b3-4260-b556-f3d2f48dc04d tempest-ProjectMemberTests-369224070 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:09:24 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-4af76401-79b3-4260-b556-f3d2f48dc04d tempest-ProjectMemberTests-369224070 None] Deleted volume successfully.
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-4af76401-79b3-4260-b556-f3d2f48dc04d tempest-ProjectMemberTests-369224070 None] Lock "cinder-d11b38e4-e3be-4298-b768-45bc35e6214d-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Flow 'volume_create_manager' (e95b5a9b-a982-4dbc-a87c-36dcd9088ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00ed9fb-e7c8-4847-bbc0-d91258562bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00ed9fb-e7c8-4847-bbc0-d91258562bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1158516755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76bdb6b0-1390-4b25-9b51-c766b3337646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3bec3eae6a463fbbef6576bb85077b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:25Z,use_quota=True,user_id='fccb6cabb20d46fa8276df523be9732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9909e611-4a56-41c3-82e5-0f3f523d24c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9909e611-4a56-41c3-82e5-0f3f523d24c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49cb3bfe-0993-4aad-98f9-afa7b7aaf1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49cb3bfe-0993-4aad-98f9-afa7b7aaf1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76bdb6b0-1390-4b25-9b51-c766b3337646', 'volume_name': 'volume-76bdb6b0-1390-4b25-9b51-c766b3337646', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a58c0a3-bca9-4ccc-9b27-e1f7f99d6f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a58c0a3-bca9-4ccc-9b27-e1f7f99d6f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a264a02-b9ca-4af2-914e-b2bee93e40e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:24 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Volume 76bdb6b0-1390-4b25-9b51-c766b3337646: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76bdb6b0-1390-4b25-9b51-c766b3337646', 'volume_size': 1}
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1158516755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76bdb6b0-1390-4b25-9b51-c766b3337646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3bec3eae6a463fbbef6576bb85077b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:25Z,use_quota=True,user_id='fccb6cabb20d46fa8276df523be9732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Creating volume 76bdb6b0-1390-4b25-9b51-c766b3337646 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:24 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:25 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:25 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:09:25 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:09:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:25 devstack sudo[108066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646 1073741824
Sep 04 16:09:25 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:25 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646 1073741824" returned: 0 in 0.541s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:25 devstack sudo[108072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646
Sep 04 16:09:25 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:25 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646" returned: 0 in 0.286s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:25 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:09:25 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a264a02-b9ca-4af2-914e-b2bee93e40e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76bdb6b0-1390-4b25-9b51-c766b3337646', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7448a0d6-5f69-47d1-95a1-12a9e3d0bfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:25 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Volume volume-76bdb6b0-1390-4b25-9b51-c766b3337646 (76bdb6b0-1390-4b25-9b51-c766b3337646): created successfully
Sep 04 16:09:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7448a0d6-5f69-47d1-95a1-12a9e3d0bfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:25 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Flow 'volume_create_manager' (e95b5a9b-a982-4dbc-a87c-36dcd9088ba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:25 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-328b1dfe-c1d7-4eab-ab72-d8a34293acbf tempest-ProjectMemberTests-369224070 None] Created volume successfully.
Sep 04 16:09:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9ed5ab02-d1d2-4315-b195-767af53dfb61 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9ed5ab02-d1d2-4315-b195-767af53dfb61 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:27 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-9ed5ab02-d1d2-4315-b195-767af53dfb61 tempest-ProjectMemberTests-369224070 None] Creating offline snapshot e5acb9cf-2a6c-4e94-a9c9-b162351b7155 of volume 76bdb6b0-1390-4b25-9b51-c766b3337646 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 16:09:27 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc6e395-0f4c-41a5-aa57-55bfc299eea2]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9ed5ab02-d1d2-4315-b195-767af53dfb61 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:27 devstack sudo[108076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646
Sep 04 16:09:27 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:27 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9ed5ab02-d1d2-4315-b195-767af53dfb61 tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646" returned: 0 in 0.426s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9ed5ab02-d1d2-4315-b195-767af53dfb61 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.e5acb9cf-2a6c-4e94-a9c9-b162351b7155 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:27 devstack sudo[108081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.e5acb9cf-2a6c-4e94-a9c9-b162351b7155 1G
Sep 04 16:09:27 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:27 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9ed5ab02-d1d2-4315-b195-767af53dfb61 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.e5acb9cf-2a6c-4e94-a9c9-b162351b7155 1G" returned: 0 in 0.431s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:27 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9ed5ab02-d1d2-4315-b195-767af53dfb61 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76bdb6b0-1390-4b25-9b51-c766b3337646 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.e5acb9cf-2a6c-4e94-a9c9-b162351b7155 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:28 devstack sudo[108087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76bdb6b0-1390-4b25-9b51-c766b3337646 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.e5acb9cf-2a6c-4e94-a9c9-b162351b7155
Sep 04 16:09:28 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:28 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9ed5ab02-d1d2-4315-b195-767af53dfb61 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76bdb6b0-1390-4b25-9b51-c766b3337646 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.e5acb9cf-2a6c-4e94-a9c9-b162351b7155" returned: 0 in 0.407s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:28 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-9ed5ab02-d1d2-4315-b195-767af53dfb61 tempest-ProjectMemberTests-369224070 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.e5acb9cf-2a6c-4e94-a9c9-b162351b7155 is being set with open permissions: ugo+rw
Sep 04 16:09:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9ed5ab02-d1d2-4315-b195-767af53dfb61 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.e5acb9cf-2a6c-4e94-a9c9-b162351b7155 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:28 devstack sudo[108094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.e5acb9cf-2a6c-4e94-a9c9-b162351b7155
Sep 04 16:09:28 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:28 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9ed5ab02-d1d2-4315-b195-767af53dfb61 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.e5acb9cf-2a6c-4e94-a9c9-b162351b7155" returned: 0 in 0.272s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:28 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9ed5ab02-d1d2-4315-b195-767af53dfb61 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:28 devstack sudo[108098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.info
Sep 04 16:09:28 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:29 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9ed5ab02-d1d2-4315-b195-767af53dfb61 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.info" returned: 0 in 0.283s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:29 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-9ed5ab02-d1d2-4315-b195-767af53dfb61 tempest-ProjectMemberTests-369224070 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.info is being set with open permissions: ugo+rw
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9ed5ab02-d1d2-4315-b195-767af53dfb61 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:29 devstack sudo[108101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.info
Sep 04 16:09:29 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:29 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-9ed5ab02-d1d2-4315-b195-767af53dfb61 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.info" returned: 0 in 0.284s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-9ed5ab02-d1d2-4315-b195-767af53dfb61 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.227s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:29 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-9ed5ab02-d1d2-4315-b195-767af53dfb61 tempest-ProjectMemberTests-369224070 None] Create snapshot completed successfully
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Flow 'volume_create_manager' (9eee3ef1-06ee-4032-9ac0-05ab0189d2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6595d31-4183-4fac-b75f-4ab769f5165a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6595d31-4183-4fac-b75f-4ab769f5165a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1395987955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e83a45cf238484fa28c617aeb505049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:30Z,use_quota=True,user_id='a5457dc590c54450b1de12637e9c3275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783fef62-c89e-487b-b030-cb86b560fe73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783fef62-c89e-487b-b030-cb86b560fe73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (677ad565-c245-4fae-bc0a-0f92ab066617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (677ad565-c245-4fae-bc0a-0f92ab066617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a', 'volume_name': 'volume-95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eba7db7-cd30-464a-bfd4-6a4f1f37948b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eba7db7-cd30-464a-bfd4-6a4f1f37948b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379233e7-b294-4558-bc75-061c3cdcf8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:29 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Volume 95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a', 'volume_size': 1}
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1395987955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e83a45cf238484fa28c617aeb505049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:30Z,use_quota=True,user_id='a5457dc590c54450b1de12637e9c3275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Creating volume 95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:09:29 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:09:29 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:29 devstack sudo[108105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a 1073741824
Sep 04 16:09:29 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:30 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a 1073741824" returned: 0 in 0.476s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:30 devstack sudo[108111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a
Sep 04 16:09:30 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:30 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a068403a-f391-48b4-b0bb-fe786cd06632 tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-e5acb9cf-2a6c-4e94-a9c9-b162351b7155-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:30 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a068403a-f391-48b4-b0bb-fe786cd06632 tempest-ProjectMemberTests-369224070 None] Lock "cinder-e5acb9cf-2a6c-4e94-a9c9-b162351b7155-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:30 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a068403a-f391-48b4-b0bb-fe786cd06632 tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-76bdb6b0-1390-4b25-9b51-c766b3337646" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:30 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a068403a-f391-48b4-b0bb-fe786cd06632 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-76bdb6b0-1390-4b25-9b51-c766b3337646" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:30 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a068403a-f391-48b4-b0bb-fe786cd06632 tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-e5acb9cf-2a6c-4e94-a9c9-b162351b7155" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:30 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a068403a-f391-48b4-b0bb-fe786cd06632 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-e5acb9cf-2a6c-4e94-a9c9-b162351b7155" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:30 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-a068403a-f391-48b4-b0bb-fe786cd06632 tempest-ProjectMemberTests-369224070 None] Deleting offline snapshot e5acb9cf-2a6c-4e94-a9c9-b162351b7155 of volume 76bdb6b0-1390-4b25-9b51-c766b3337646 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 16:09:30 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-a068403a-f391-48b4-b0bb-fe786cd06632 tempest-ProjectMemberTests-369224070 None] snapshot_file for this snap is: volume-76bdb6b0-1390-4b25-9b51-c766b3337646.e5acb9cf-2a6c-4e94-a9c9-b162351b7155 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 16:09:30 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[93933998-3f39-428f-b0a6-ce092cbfac96]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a068403a-f391-48b4-b0bb-fe786cd06632 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.e5acb9cf-2a6c-4e94-a9c9-b162351b7155 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:30 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a" returned: 0 in 0.297s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:30 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:09:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379233e7-b294-4558-bc75-061c3cdcf8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b523a5e-b330-40e6-abc6-b3ab2213c39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:30 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Volume volume-95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a (95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a): created successfully
Sep 04 16:09:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b523a5e-b330-40e6-abc6-b3ab2213c39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:30 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Flow 'volume_create_manager' (9eee3ef1-06ee-4032-9ac0-05ab0189d2a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:30 devstack sudo[108113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.e5acb9cf-2a6c-4e94-a9c9-b162351b7155
Sep 04 16:09:30 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:30 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f135af94-efed-47b3-a597-f6cb6602bd95 tempest-ProjectReaderTests-1904542961 None] Created volume successfully.
Sep 04 16:09:30 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a068403a-f391-48b4-b0bb-fe786cd06632 tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.e5acb9cf-2a6c-4e94-a9c9-b162351b7155" returned: 0 in 0.396s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:30 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-a068403a-f391-48b4-b0bb-fe786cd06632 tempest-ProjectMemberTests-369224070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76bdb6b0-1390-4b25-9b51-c766b3337646(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:09:30 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[70eed8c0-915a-44b1-9ae3-879a5af2a6cd]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:30 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a068403a-f391-48b4-b0bb-fe786cd06632 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:30 devstack sudo[108119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646
Sep 04 16:09:30 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:31 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a068403a-f391-48b4-b0bb-fe786cd06632 tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646" returned: 0 in 0.384s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a068403a-f391-48b4-b0bb-fe786cd06632 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.e5acb9cf-2a6c-4e94-a9c9-b162351b7155 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:31 devstack sudo[108124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.e5acb9cf-2a6c-4e94-a9c9-b162351b7155
Sep 04 16:09:31 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:31 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a068403a-f391-48b4-b0bb-fe786cd06632 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.e5acb9cf-2a6c-4e94-a9c9-b162351b7155" returned: 0 in 0.349s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a068403a-f391-48b4-b0bb-fe786cd06632 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.e5acb9cf-2a6c-4e94-a9c9-b162351b7155 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:31 devstack sudo[108129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.e5acb9cf-2a6c-4e94-a9c9-b162351b7155
Sep 04 16:09:31 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:31 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:31 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a068403a-f391-48b4-b0bb-fe786cd06632 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646.e5acb9cf-2a6c-4e94-a9c9-b162351b7155" returned: 0 in 0.306s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:31 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a068403a-f391-48b4-b0bb-fe786cd06632 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-e5acb9cf-2a6c-4e94-a9c9-b162351b7155" released by "_delete_snapshot" :: held 1.540s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:31 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a068403a-f391-48b4-b0bb-fe786cd06632 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-76bdb6b0-1390-4b25-9b51-c766b3337646" released by "delete_snapshot" :: held 1.569s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:32 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-a068403a-f391-48b4-b0bb-fe786cd06632 tempest-ProjectMemberTests-369224070 None] Created reservations ['feeecfd6-4c3d-442a-8af7-8f61aa6de1a5', 'd049f18f-444a-4be9-bdfb-f77ec73c04af', '02cafca9-9911-424b-8afd-346f1c8263ba', '0052b13b-8531-4caa-a11d-a5fc95fcad29'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:09:32 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a61b2333-9c08-490a-afe7-7b51c556e9ca tempest-ProjectReaderTests-1904542961 None] Acquiring lock "cinder-95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:32 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a61b2333-9c08-490a-afe7-7b51c556e9ca tempest-ProjectReaderTests-1904542961 None] Lock "cinder-95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:32 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-a068403a-f391-48b4-b0bb-fe786cd06632 tempest-ProjectMemberTests-369224070 None] Delete snapshot completed successfully.
Sep 04 16:09:32 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a61b2333-9c08-490a-afe7-7b51c556e9ca tempest-ProjectReaderTests-1904542961 None] Acquiring lock "cinder-quobyte-95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:32 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a068403a-f391-48b4-b0bb-fe786cd06632 tempest-ProjectMemberTests-369224070 None] Lock "cinder-e5acb9cf-2a6c-4e94-a9c9-b162351b7155-delete_snapshot" released by "delete_snapshot" :: held 1.770s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:32 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a61b2333-9c08-490a-afe7-7b51c556e9ca tempest-ProjectReaderTests-1904542961 None] Lock "cinder-quobyte-95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a" acquired by "delete_volume" :: waited 0.015s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:32 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ea6f03-8344-4b41-a66a-c6592d265e9f]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a61b2333-9c08-490a-afe7-7b51c556e9ca tempest-ProjectReaderTests-1904542961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:32 devstack sudo[108132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a
Sep 04 16:09:32 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:32 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a61b2333-9c08-490a-afe7-7b51c556e9ca tempest-ProjectReaderTests-1904542961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a" returned: 0 in 0.345s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a61b2333-9c08-490a-afe7-7b51c556e9ca tempest-ProjectReaderTests-1904542961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:32 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f97ff5f0-212f-47ea-8464-f2c93614fc25 tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-76bdb6b0-1390-4b25-9b51-c766b3337646-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:32 devstack sudo[108137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a
Sep 04 16:09:32 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:32 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f97ff5f0-212f-47ea-8464-f2c93614fc25 tempest-ProjectMemberTests-369224070 None] Lock "cinder-76bdb6b0-1390-4b25-9b51-c766b3337646-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:32 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f97ff5f0-212f-47ea-8464-f2c93614fc25 tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-76bdb6b0-1390-4b25-9b51-c766b3337646" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:32 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f97ff5f0-212f-47ea-8464-f2c93614fc25 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-76bdb6b0-1390-4b25-9b51-c766b3337646" acquired by "delete_volume" :: waited 0.013s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:32 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5c3b49-feaa-4f6f-8ce5-dc6d1fa7c4b7]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f97ff5f0-212f-47ea-8464-f2c93614fc25 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:32 devstack sudo[108139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646
Sep 04 16:09:32 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:32 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a61b2333-9c08-490a-afe7-7b51c556e9ca tempest-ProjectReaderTests-1904542961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a" returned: 0 in 0.318s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:32 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a61b2333-9c08-490a-afe7-7b51c556e9ca tempest-ProjectReaderTests-1904542961 None] Lock "cinder-quobyte-95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a" released by "delete_volume" :: held 0.701s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:32 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-a61b2333-9c08-490a-afe7-7b51c556e9ca tempest-ProjectReaderTests-1904542961 None] Created reservations ['a669217f-fde9-41ad-8374-161c992e0845', 'f6e57427-ef24-426e-bf26-2c7cb795f999', '19243701-a588-4820-a181-03d17dd66c5f', 'd4f6f6b2-906a-4bea-994f-8e31dff25fd8'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:09:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a61b2333-9c08-490a-afe7-7b51c556e9ca tempest-ProjectReaderTests-1904542961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a61b2333-9c08-490a-afe7-7b51c556e9ca tempest-ProjectReaderTests-1904542961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:32 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a61b2333-9c08-490a-afe7-7b51c556e9ca tempest-ProjectReaderTests-1904542961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:32 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-a61b2333-9c08-490a-afe7-7b51c556e9ca tempest-ProjectReaderTests-1904542961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-a61b2333-9c08-490a-afe7-7b51c556e9ca tempest-ProjectReaderTests-1904542961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:32 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a61b2333-9c08-490a-afe7-7b51c556e9ca tempest-ProjectReaderTests-1904542961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:32 devstack sudo[108144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:09:32 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:33 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f97ff5f0-212f-47ea-8464-f2c93614fc25 tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646" returned: 0 in 0.377s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f97ff5f0-212f-47ea-8464-f2c93614fc25 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:33 devstack sudo[108147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646
Sep 04 16:09:33 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:33 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-a61b2333-9c08-490a-afe7-7b51c556e9ca tempest-ProjectReaderTests-1904542961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.275s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-a61b2333-9c08-490a-afe7-7b51c556e9ca tempest-ProjectReaderTests-1904542961 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:09:33 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-a61b2333-9c08-490a-afe7-7b51c556e9ca tempest-ProjectReaderTests-1904542961 None] Deleted volume successfully.
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-a61b2333-9c08-490a-afe7-7b51c556e9ca tempest-ProjectReaderTests-1904542961 None] Lock "cinder-95d6fd45-68ca-4f3a-91a0-fa1d8cf18b6a-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:33 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f97ff5f0-212f-47ea-8464-f2c93614fc25 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-76bdb6b0-1390-4b25-9b51-c766b3337646" returned: 0 in 0.304s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f97ff5f0-212f-47ea-8464-f2c93614fc25 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-76bdb6b0-1390-4b25-9b51-c766b3337646" released by "delete_volume" :: held 0.741s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-f97ff5f0-212f-47ea-8464-f2c93614fc25 tempest-ProjectMemberTests-369224070 None] Created reservations ['3b06ba95-76d9-482c-bb6d-eb413a8a20dc', 'aba5b9e6-2cbb-489e-be41-2d5281e862b2', '4ebafeb5-0f9e-4e2c-ba06-c9b765853958', 'e3ec6711-0c5c-4f3b-a4e3-0d2dcc253324'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f97ff5f0-212f-47ea-8464-f2c93614fc25 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f97ff5f0-212f-47ea-8464-f2c93614fc25 tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f97ff5f0-212f-47ea-8464-f2c93614fc25 tempest-ProjectMemberTests-369224070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f97ff5f0-212f-47ea-8464-f2c93614fc25 tempest-ProjectMemberTests-369224070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f97ff5f0-212f-47ea-8464-f2c93614fc25 tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f97ff5f0-212f-47ea-8464-f2c93614fc25 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:33 devstack sudo[108151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:09:33 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Flow 'volume_create_manager' (e663d044-93b5-44eb-b463-e926a1ba338b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d56944-e0e5-421f-9d68-cfc927454571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=144,cinder:INSERT=57,cinder:UPDATE=183,cinder:DELETE=14 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:09:33 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f97ff5f0-212f-47ea-8464-f2c93614fc25 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.278s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-f97ff5f0-212f-47ea-8464-f2c93614fc25 tempest-ProjectMemberTests-369224070 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d56944-e0e5-421f-9d68-cfc927454571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-492000147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2931a100-8ab9-4fd5-9d87-7a7ab266cafd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e83a45cf238484fa28c617aeb505049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:34Z,use_quota=True,user_id='a5457dc590c54450b1de12637e9c3275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb515002-54f2-45ae-b045-8408660e29af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb515002-54f2-45ae-b045-8408660e29af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d97f265-96be-44e6-927b-b577f6b9bd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d97f265-96be-44e6-927b-b577f6b9bd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2931a100-8ab9-4fd5-9d87-7a7ab266cafd', 'volume_name': 'volume-2931a100-8ab9-4fd5-9d87-7a7ab266cafd', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0447bae-d513-4586-a526-22b9085ef384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0447bae-d513-4586-a526-22b9085ef384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2874dd05-3531-4b5e-a857-ca5dbfdc60eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:33 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Volume 2931a100-8ab9-4fd5-9d87-7a7ab266cafd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2931a100-8ab9-4fd5-9d87-7a7ab266cafd', 'volume_size': 1}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-492000147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2931a100-8ab9-4fd5-9d87-7a7ab266cafd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e83a45cf238484fa28c617aeb505049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:34Z,use_quota=True,user_id='a5457dc590c54450b1de12637e9c3275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Creating volume 2931a100-8ab9-4fd5-9d87-7a7ab266cafd {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:09:33 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2931a100-8ab9-4fd5-9d87-7a7ab266cafd 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:33 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f97ff5f0-212f-47ea-8464-f2c93614fc25 tempest-ProjectMemberTests-369224070 None] Deleted volume successfully.
Sep 04 16:09:33 devstack sudo[108154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2931a100-8ab9-4fd5-9d87-7a7ab266cafd 1073741824
Sep 04 16:09:33 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:33 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f97ff5f0-212f-47ea-8464-f2c93614fc25 tempest-ProjectMemberTests-369224070 None] Lock "cinder-76bdb6b0-1390-4b25-9b51-c766b3337646-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=157,cinder:INSERT=45,cinder:UPDATE=192,cinder:DELETE=16 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Flow 'volume_create_manager' (a1d60fcd-4400-44b1-a40a-45aec2d5ce59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (892511f3-2e70-4e0a-9539-d214ef09c9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (892511f3-2e70-4e0a-9539-d214ef09c9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1146005351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=902d95e4-649d-49cd-9ceb-da58e6062f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3bec3eae6a463fbbef6576bb85077b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:34Z,use_quota=True,user_id='fccb6cabb20d46fa8276df523be9732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38af99be-76f0-4d50-b794-c4474ffe52ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38af99be-76f0-4d50-b794-c4474ffe52ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (361cd8de-10dd-4b9a-a65c-8755cbfa826b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (361cd8de-10dd-4b9a-a65c-8755cbfa826b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '902d95e4-649d-49cd-9ceb-da58e6062f04', 'volume_name': 'volume-902d95e4-649d-49cd-9ceb-da58e6062f04', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da1d013-5017-4f0c-9009-3cac86ed6ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da1d013-5017-4f0c-9009-3cac86ed6ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ec7e4d-97dc-4da6-a209-224c52f3c79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:34 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Volume 902d95e4-649d-49cd-9ceb-da58e6062f04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-902d95e4-649d-49cd-9ceb-da58e6062f04', 'volume_size': 1}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:34 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2931a100-8ab9-4fd5-9d87-7a7ab266cafd 1073741824" returned: 0 in 0.475s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2931a100-8ab9-4fd5-9d87-7a7ab266cafd {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:34 devstack sudo[108160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2931a100-8ab9-4fd5-9d87-7a7ab266cafd
Sep 04 16:09:34 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:34 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2931a100-8ab9-4fd5-9d87-7a7ab266cafd" returned: 0 in 0.232s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.282s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1146005351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=902d95e4-649d-49cd-9ceb-da58e6062f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3bec3eae6a463fbbef6576bb85077b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:34Z,use_quota=True,user_id='fccb6cabb20d46fa8276df523be9732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Creating volume 902d95e4-649d-49cd-9ceb-da58e6062f04 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:09:34 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:34 devstack sudo[108163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04 1073741824
Sep 04 16:09:34 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2874dd05-3531-4b5e-a857-ca5dbfdc60eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2931a100-8ab9-4fd5-9d87-7a7ab266cafd', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c7ea88-125c-47b0-9267-00939bea5ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:34 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Volume volume-2931a100-8ab9-4fd5-9d87-7a7ab266cafd (2931a100-8ab9-4fd5-9d87-7a7ab266cafd): created successfully
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c7ea88-125c-47b0-9267-00939bea5ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Flow 'volume_create_manager' (e663d044-93b5-44eb-b463-e926a1ba338b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:34 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-7adb7245-4b72-49bf-a50e-152c31085c28 tempest-ProjectReaderTests-1904542961 None] Created volume successfully.
Sep 04 16:09:34 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:34 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04 1073741824" returned: 0 in 0.428s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:35 devstack sudo[108170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04
Sep 04 16:09:35 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:35 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04" returned: 0 in 0.253s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:35 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:09:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ec7e4d-97dc-4da6-a209-224c52f3c79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-902d95e4-649d-49cd-9ceb-da58e6062f04', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c4019a-e30d-4fd3-9d50-3a9e3ace4a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:35 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Volume volume-902d95e4-649d-49cd-9ceb-da58e6062f04 (902d95e4-649d-49cd-9ceb-da58e6062f04): created successfully
Sep 04 16:09:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c4019a-e30d-4fd3-9d50-3a9e3ace4a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:35 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Flow 'volume_create_manager' (a1d60fcd-4400-44b1-a40a-45aec2d5ce59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:35 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-593dccce-d145-4023-b5fe-9e503e36c163 tempest-ProjectMemberTests-369224070 None] Created volume successfully.
Sep 04 16:09:35 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-73bae4f6-faf7-47c0-8197-4c0c4a2dc42f tempest-ProjectReaderTests-1904542961 None] Acquiring lock "cinder-2931a100-8ab9-4fd5-9d87-7a7ab266cafd-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:35 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-73bae4f6-faf7-47c0-8197-4c0c4a2dc42f tempest-ProjectReaderTests-1904542961 None] Lock "cinder-2931a100-8ab9-4fd5-9d87-7a7ab266cafd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:35 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-73bae4f6-faf7-47c0-8197-4c0c4a2dc42f tempest-ProjectReaderTests-1904542961 None] Acquiring lock "cinder-quobyte-2931a100-8ab9-4fd5-9d87-7a7ab266cafd" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:35 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-73bae4f6-faf7-47c0-8197-4c0c4a2dc42f tempest-ProjectReaderTests-1904542961 None] Lock "cinder-quobyte-2931a100-8ab9-4fd5-9d87-7a7ab266cafd" acquired by "delete_volume" :: waited 0.017s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:35 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f20de4-0246-48cb-9a91-f16b0868b5ed]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:35 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-73bae4f6-faf7-47c0-8197-4c0c4a2dc42f tempest-ProjectReaderTests-1904542961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2931a100-8ab9-4fd5-9d87-7a7ab266cafd {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:36 devstack sudo[108173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2931a100-8ab9-4fd5-9d87-7a7ab266cafd
Sep 04 16:09:36 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:36 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-73bae4f6-faf7-47c0-8197-4c0c4a2dc42f tempest-ProjectReaderTests-1904542961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2931a100-8ab9-4fd5-9d87-7a7ab266cafd" returned: 0 in 0.373s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-73bae4f6-faf7-47c0-8197-4c0c4a2dc42f tempest-ProjectReaderTests-1904542961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2931a100-8ab9-4fd5-9d87-7a7ab266cafd {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:36 devstack sudo[108178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2931a100-8ab9-4fd5-9d87-7a7ab266cafd
Sep 04 16:09:36 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-586117df-a049-4d10-8446-05c92913c3b4 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-586117df-a049-4d10-8446-05c92913c3b4 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:36 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-586117df-a049-4d10-8446-05c92913c3b4 tempest-ProjectMemberTests-369224070 None] Creating offline snapshot 6d77aa4a-f80f-4ff3-a402-e5a772eea92d of volume 902d95e4-649d-49cd-9ceb-da58e6062f04 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 16:09:36 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccaa2af-d879-44db-b8a4-f7511f2c5595]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-586117df-a049-4d10-8446-05c92913c3b4 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:36 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-73bae4f6-faf7-47c0-8197-4c0c4a2dc42f tempest-ProjectReaderTests-1904542961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-2931a100-8ab9-4fd5-9d87-7a7ab266cafd" returned: 0 in 0.271s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:36 devstack sudo[108180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04
Sep 04 16:09:36 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:36 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-73bae4f6-faf7-47c0-8197-4c0c4a2dc42f tempest-ProjectReaderTests-1904542961 None] Lock "cinder-quobyte-2931a100-8ab9-4fd5-9d87-7a7ab266cafd" released by "delete_volume" :: held 0.691s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:36 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-73bae4f6-faf7-47c0-8197-4c0c4a2dc42f tempest-ProjectReaderTests-1904542961 None] Created reservations ['46dd3a09-3ea1-44db-b6f9-6ddfffd8b6a8', '22e948b7-a15a-4170-a901-14c4cd8d865e', '08d0bb78-e632-48ca-9b0a-a005fd09879e', 'ef07f7a8-640d-46c6-a1fb-a0b61e294cfa'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:09:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-73bae4f6-faf7-47c0-8197-4c0c4a2dc42f tempest-ProjectReaderTests-1904542961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-73bae4f6-faf7-47c0-8197-4c0c4a2dc42f tempest-ProjectReaderTests-1904542961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:36 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-73bae4f6-faf7-47c0-8197-4c0c4a2dc42f tempest-ProjectReaderTests-1904542961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:36 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-73bae4f6-faf7-47c0-8197-4c0c4a2dc42f tempest-ProjectReaderTests-1904542961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-73bae4f6-faf7-47c0-8197-4c0c4a2dc42f tempest-ProjectReaderTests-1904542961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-73bae4f6-faf7-47c0-8197-4c0c4a2dc42f tempest-ProjectReaderTests-1904542961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:36 devstack sudo[108183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:09:36 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:36 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-586117df-a049-4d10-8446-05c92913c3b4 tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04" returned: 0 in 0.384s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-586117df-a049-4d10-8446-05c92913c3b4 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.6d77aa4a-f80f-4ff3-a402-e5a772eea92d 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:36 devstack sudo[108188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.6d77aa4a-f80f-4ff3-a402-e5a772eea92d 1G
Sep 04 16:09:36 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:36 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:36 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-73bae4f6-faf7-47c0-8197-4c0c4a2dc42f tempest-ProjectReaderTests-1904542961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.258s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:36 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-73bae4f6-faf7-47c0-8197-4c0c4a2dc42f tempest-ProjectReaderTests-1904542961 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:09:36 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-73bae4f6-faf7-47c0-8197-4c0c4a2dc42f tempest-ProjectReaderTests-1904542961 None] Deleted volume successfully.
Sep 04 16:09:37 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-73bae4f6-faf7-47c0-8197-4c0c4a2dc42f tempest-ProjectReaderTests-1904542961 None] Lock "cinder-2931a100-8ab9-4fd5-9d87-7a7ab266cafd-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:37 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-586117df-a049-4d10-8446-05c92913c3b4 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.6d77aa4a-f80f-4ff3-a402-e5a772eea92d 1G" returned: 0 in 0.466s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-586117df-a049-4d10-8446-05c92913c3b4 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-902d95e4-649d-49cd-9ceb-da58e6062f04 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.6d77aa4a-f80f-4ff3-a402-e5a772eea92d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:37 devstack sudo[108195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-902d95e4-649d-49cd-9ceb-da58e6062f04 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.6d77aa4a-f80f-4ff3-a402-e5a772eea92d
Sep 04 16:09:37 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:37 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:09:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Flow 'volume_create_manager' (dd8c1bc9-d9ad-4424-ab28-fd685c5625ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3187586f-9ada-4f0e-a237-8e892d396606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3187586f-9ada-4f0e-a237-8e892d396606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1366781255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12230a9-5c55-4366-8f7f-78f376c2b627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e83a45cf238484fa28c617aeb505049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:37Z,use_quota=True,user_id='a5457dc590c54450b1de12637e9c3275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea602ee9-2c2f-4044-a840-6eaf145117c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea602ee9-2c2f-4044-a840-6eaf145117c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cacab8-c6d6-4f94-ae82-44e7f049c49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cacab8-c6d6-4f94-ae82-44e7f049c49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a12230a9-5c55-4366-8f7f-78f376c2b627', 'volume_name': 'volume-a12230a9-5c55-4366-8f7f-78f376c2b627', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51df4dd-f2ed-43c1-b8e4-46f5f7e2f9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51df4dd-f2ed-43c1-b8e4-46f5f7e2f9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:37 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7878c7-ad37-4317-9d8b-a543f53aea51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:37 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Volume a12230a9-5c55-4366-8f7f-78f376c2b627: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a12230a9-5c55-4366-8f7f-78f376c2b627', 'volume_size': 1}
Sep 04 16:09:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:37 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-586117df-a049-4d10-8446-05c92913c3b4 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-902d95e4-649d-49cd-9ceb-da58e6062f04 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.6d77aa4a-f80f-4ff3-a402-e5a772eea92d" returned: 0 in 0.336s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:37 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-586117df-a049-4d10-8446-05c92913c3b4 tempest-ProjectMemberTests-369224070 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.6d77aa4a-f80f-4ff3-a402-e5a772eea92d is being set with open permissions: ugo+rw
Sep 04 16:09:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-586117df-a049-4d10-8446-05c92913c3b4 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.6d77aa4a-f80f-4ff3-a402-e5a772eea92d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:37 devstack sudo[108201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.6d77aa4a-f80f-4ff3-a402-e5a772eea92d
Sep 04 16:09:37 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:37 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-586117df-a049-4d10-8446-05c92913c3b4 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.6d77aa4a-f80f-4ff3-a402-e5a772eea92d" returned: 0 in 0.292s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:37 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-586117df-a049-4d10-8446-05c92913c3b4 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:37 devstack sudo[108204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.info
Sep 04 16:09:37 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:38 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-586117df-a049-4d10-8446-05c92913c3b4 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.info" returned: 0 in 0.288s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:38 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-586117df-a049-4d10-8446-05c92913c3b4 tempest-ProjectMemberTests-369224070 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.info is being set with open permissions: ugo+rw
Sep 04 16:09:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-586117df-a049-4d10-8446-05c92913c3b4 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:38 devstack sudo[108207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.info
Sep 04 16:09:38 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:38 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-586117df-a049-4d10-8446-05c92913c3b4 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.info" returned: 0 in 0.293s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-586117df-a049-4d10-8446-05c92913c3b4 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.149s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.945s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1366781255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12230a9-5c55-4366-8f7f-78f376c2b627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e83a45cf238484fa28c617aeb505049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:37Z,use_quota=True,user_id='a5457dc590c54450b1de12637e9c3275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:09:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Creating volume a12230a9-5c55-4366-8f7f-78f376c2b627 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:09:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:38 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:09:38 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:09:38 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a12230a9-5c55-4366-8f7f-78f376c2b627 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:38 devstack sudo[108210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a12230a9-5c55-4366-8f7f-78f376c2b627 1073741824
Sep 04 16:09:38 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:38 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-586117df-a049-4d10-8446-05c92913c3b4 tempest-ProjectMemberTests-369224070 None] Create snapshot completed successfully
Sep 04 16:09:39 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a12230a9-5c55-4366-8f7f-78f376c2b627 1073741824" returned: 0 in 0.465s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a12230a9-5c55-4366-8f7f-78f376c2b627 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:39 devstack sudo[108216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a12230a9-5c55-4366-8f7f-78f376c2b627
Sep 04 16:09:39 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:39 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a12230a9-5c55-4366-8f7f-78f376c2b627" returned: 0 in 0.291s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:39 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:09:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7878c7-ad37-4317-9d8b-a543f53aea51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a12230a9-5c55-4366-8f7f-78f376c2b627', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c413fc-a2e7-4096-869a-7cc7a2a24cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:39 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Volume volume-a12230a9-5c55-4366-8f7f-78f376c2b627 (a12230a9-5c55-4366-8f7f-78f376c2b627): created successfully
Sep 04 16:09:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c413fc-a2e7-4096-869a-7cc7a2a24cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:39 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Flow 'volume_create_manager' (dd8c1bc9-d9ad-4424-ab28-fd685c5625ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:39 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-577e981a-2145-4953-9a35-ec748b2634e1 tempest-ProjectReaderTests-1904542961 None] Created volume successfully.
Sep 04 16:09:39 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d0c95a0a-537e-4fa6-8b7c-4143815cb724 tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-6d77aa4a-f80f-4ff3-a402-e5a772eea92d-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:39 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d0c95a0a-537e-4fa6-8b7c-4143815cb724 tempest-ProjectMemberTests-369224070 None] Lock "cinder-6d77aa4a-f80f-4ff3-a402-e5a772eea92d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:39 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d0c95a0a-537e-4fa6-8b7c-4143815cb724 tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-902d95e4-649d-49cd-9ceb-da58e6062f04" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:39 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-eaa39069-3977-4837-aaff-6bd4a920b7ec tempest-ProjectReaderTests-1904542961 None] Acquiring lock "cinder-a12230a9-5c55-4366-8f7f-78f376c2b627-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:39 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d0c95a0a-537e-4fa6-8b7c-4143815cb724 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-902d95e4-649d-49cd-9ceb-da58e6062f04" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:39 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d0c95a0a-537e-4fa6-8b7c-4143815cb724 tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-6d77aa4a-f80f-4ff3-a402-e5a772eea92d" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:39 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d0c95a0a-537e-4fa6-8b7c-4143815cb724 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-6d77aa4a-f80f-4ff3-a402-e5a772eea92d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:39 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-d0c95a0a-537e-4fa6-8b7c-4143815cb724 tempest-ProjectMemberTests-369224070 None] Deleting offline snapshot 6d77aa4a-f80f-4ff3-a402-e5a772eea92d of volume 902d95e4-649d-49cd-9ceb-da58e6062f04 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 16:09:39 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-d0c95a0a-537e-4fa6-8b7c-4143815cb724 tempest-ProjectMemberTests-369224070 None] snapshot_file for this snap is: volume-902d95e4-649d-49cd-9ceb-da58e6062f04.6d77aa4a-f80f-4ff3-a402-e5a772eea92d {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 16:09:39 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-eaa39069-3977-4837-aaff-6bd4a920b7ec tempest-ProjectReaderTests-1904542961 None] Lock "cinder-a12230a9-5c55-4366-8f7f-78f376c2b627-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:39 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77c8ed8-7663-4323-a95f-cf7246705b32]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d0c95a0a-537e-4fa6-8b7c-4143815cb724 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.6d77aa4a-f80f-4ff3-a402-e5a772eea92d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:39 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-eaa39069-3977-4837-aaff-6bd4a920b7ec tempest-ProjectReaderTests-1904542961 None] Acquiring lock "cinder-quobyte-a12230a9-5c55-4366-8f7f-78f376c2b627" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:39 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-eaa39069-3977-4837-aaff-6bd4a920b7ec tempest-ProjectReaderTests-1904542961 None] Lock "cinder-quobyte-a12230a9-5c55-4366-8f7f-78f376c2b627" acquired by "delete_volume" :: waited 0.024s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:39 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[53be2814-6152-46a2-89d8-8b61d3970ac9]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:39 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-eaa39069-3977-4837-aaff-6bd4a920b7ec tempest-ProjectReaderTests-1904542961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a12230a9-5c55-4366-8f7f-78f376c2b627 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:39 devstack sudo[108219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.6d77aa4a-f80f-4ff3-a402-e5a772eea92d
Sep 04 16:09:39 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:39 devstack sudo[108220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a12230a9-5c55-4366-8f7f-78f376c2b627
Sep 04 16:09:39 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:40 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d0c95a0a-537e-4fa6-8b7c-4143815cb724 tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.6d77aa4a-f80f-4ff3-a402-e5a772eea92d" returned: 0 in 0.376s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:40 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-d0c95a0a-537e-4fa6-8b7c-4143815cb724 tempest-ProjectMemberTests-369224070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-902d95e4-649d-49cd-9ceb-da58e6062f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:09:40 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cc25fb-de5b-414f-970c-cb7b35ad7b4f]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d0c95a0a-537e-4fa6-8b7c-4143815cb724 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:40 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-eaa39069-3977-4837-aaff-6bd4a920b7ec tempest-ProjectReaderTests-1904542961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a12230a9-5c55-4366-8f7f-78f376c2b627" returned: 0 in 0.405s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-eaa39069-3977-4837-aaff-6bd4a920b7ec tempest-ProjectReaderTests-1904542961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a12230a9-5c55-4366-8f7f-78f376c2b627 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:40 devstack sudo[108226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04
Sep 04 16:09:40 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:40 devstack sudo[108230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a12230a9-5c55-4366-8f7f-78f376c2b627
Sep 04 16:09:40 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:40 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d0c95a0a-537e-4fa6-8b7c-4143815cb724 tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04" returned: 0 in 0.376s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d0c95a0a-537e-4fa6-8b7c-4143815cb724 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.6d77aa4a-f80f-4ff3-a402-e5a772eea92d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:40 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-eaa39069-3977-4837-aaff-6bd4a920b7ec tempest-ProjectReaderTests-1904542961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a12230a9-5c55-4366-8f7f-78f376c2b627" returned: 0 in 0.295s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:40 devstack sudo[108237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.6d77aa4a-f80f-4ff3-a402-e5a772eea92d
Sep 04 16:09:40 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:40 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-eaa39069-3977-4837-aaff-6bd4a920b7ec tempest-ProjectReaderTests-1904542961 None] Lock "cinder-quobyte-a12230a9-5c55-4366-8f7f-78f376c2b627" released by "delete_volume" :: held 0.747s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:40 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-eaa39069-3977-4837-aaff-6bd4a920b7ec tempest-ProjectReaderTests-1904542961 None] Created reservations ['b482fdbf-cc0a-4f2c-8e94-8c52b521fedf', 'bbe26b0c-a059-48b4-bbf3-aa398604b6f6', '1470908c-3083-43c1-9d80-4a5f4bd7b77f', '0334ae02-4a5a-4691-921c-e57a4aa9cbd7'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:09:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-eaa39069-3977-4837-aaff-6bd4a920b7ec tempest-ProjectReaderTests-1904542961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-eaa39069-3977-4837-aaff-6bd4a920b7ec tempest-ProjectReaderTests-1904542961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:40 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-eaa39069-3977-4837-aaff-6bd4a920b7ec tempest-ProjectReaderTests-1904542961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:40 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-eaa39069-3977-4837-aaff-6bd4a920b7ec tempest-ProjectReaderTests-1904542961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-eaa39069-3977-4837-aaff-6bd4a920b7ec tempest-ProjectReaderTests-1904542961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-eaa39069-3977-4837-aaff-6bd4a920b7ec tempest-ProjectReaderTests-1904542961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:40 devstack sudo[108239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:09:40 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:40 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d0c95a0a-537e-4fa6-8b7c-4143815cb724 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.6d77aa4a-f80f-4ff3-a402-e5a772eea92d" returned: 0 in 0.391s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d0c95a0a-537e-4fa6-8b7c-4143815cb724 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.6d77aa4a-f80f-4ff3-a402-e5a772eea92d {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:40 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:40 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-eaa39069-3977-4837-aaff-6bd4a920b7ec tempest-ProjectReaderTests-1904542961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.264s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:40 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-eaa39069-3977-4837-aaff-6bd4a920b7ec tempest-ProjectReaderTests-1904542961 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:09:40 devstack sudo[108245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.6d77aa4a-f80f-4ff3-a402-e5a772eea92d
Sep 04 16:09:40 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:40 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-eaa39069-3977-4837-aaff-6bd4a920b7ec tempest-ProjectReaderTests-1904542961 None] Deleted volume successfully.
Sep 04 16:09:40 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-eaa39069-3977-4837-aaff-6bd4a920b7ec tempest-ProjectReaderTests-1904542961 None] Lock "cinder-a12230a9-5c55-4366-8f7f-78f376c2b627-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:41 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-d0c95a0a-537e-4fa6-8b7c-4143815cb724 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04.6d77aa4a-f80f-4ff3-a402-e5a772eea92d" returned: 0 in 0.309s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d0c95a0a-537e-4fa6-8b7c-4143815cb724 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-6d77aa4a-f80f-4ff3-a402-e5a772eea92d" released by "_delete_snapshot" :: held 1.555s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d0c95a0a-537e-4fa6-8b7c-4143815cb724 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-902d95e4-649d-49cd-9ceb-da58e6062f04" released by "delete_snapshot" :: held 1.584s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-d0c95a0a-537e-4fa6-8b7c-4143815cb724 tempest-ProjectMemberTests-369224070 None] Created reservations ['f0f5bb21-3fd7-4ef0-9f07-149b33d55c8f', '9b15b0c6-8965-49fb-96d3-6e54be012384', '0cb19808-1d2b-4986-9536-021d35c3d86c', '63163888-bf13-4cab-9c53-0eff3cbb53e3'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Flow 'volume_create_manager' (4770eed0-0dfe-4ecb-b4ea-16068235569f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6016ca4-6fcb-4e7f-81a0-a2d0fcfbf2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6016ca4-6fcb-4e7f-81a0-a2d0fcfbf2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-748165268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b16ea0-46b1-43da-8007-85e6e3d797e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e83a45cf238484fa28c617aeb505049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:41Z,use_quota=True,user_id='a5457dc590c54450b1de12637e9c3275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1c78de-3702-4227-b19a-ad963a0189d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1c78de-3702-4227-b19a-ad963a0189d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955eebb1-b2f0-44c8-8688-7c2b05864af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955eebb1-b2f0-44c8-8688-7c2b05864af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44b16ea0-46b1-43da-8007-85e6e3d797e8', 'volume_name': 'volume-44b16ea0-46b1-43da-8007-85e6e3d797e8', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b25049-efca-4722-a064-78c8fd337ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b25049-efca-4722-a064-78c8fd337ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdae8a4c-5d08-44eb-b8d2-31a6fb5bde56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:41 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Volume 44b16ea0-46b1-43da-8007-85e6e3d797e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44b16ea0-46b1-43da-8007-85e6e3d797e8', 'volume_size': 1}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-748165268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b16ea0-46b1-43da-8007-85e6e3d797e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e83a45cf238484fa28c617aeb505049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:41Z,use_quota=True,user_id='a5457dc590c54450b1de12637e9c3275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Creating volume 44b16ea0-46b1-43da-8007-85e6e3d797e8 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:09:41 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-44b16ea0-46b1-43da-8007-85e6e3d797e8 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:41 devstack sudo[108248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-44b16ea0-46b1-43da-8007-85e6e3d797e8 1073741824
Sep 04 16:09:41 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:41 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-d0c95a0a-537e-4fa6-8b7c-4143815cb724 tempest-ProjectMemberTests-369224070 None] Delete snapshot completed successfully.
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-d0c95a0a-537e-4fa6-8b7c-4143815cb724 tempest-ProjectMemberTests-369224070 None] Lock "cinder-6d77aa4a-f80f-4ff3-a402-e5a772eea92d-delete_snapshot" released by "delete_snapshot" :: held 1.849s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-54bce6bb-5a1b-4069-86e5-ec1aa757cff8 tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-902d95e4-649d-49cd-9ceb-da58e6062f04-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-54bce6bb-5a1b-4069-86e5-ec1aa757cff8 tempest-ProjectMemberTests-369224070 None] Lock "cinder-902d95e4-649d-49cd-9ceb-da58e6062f04-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-54bce6bb-5a1b-4069-86e5-ec1aa757cff8 tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-902d95e4-649d-49cd-9ceb-da58e6062f04" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-54bce6bb-5a1b-4069-86e5-ec1aa757cff8 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-902d95e4-649d-49cd-9ceb-da58e6062f04" acquired by "delete_volume" :: waited 0.016s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2bdde8-b30c-4d69-965e-1ea41978a5b3]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-54bce6bb-5a1b-4069-86e5-ec1aa757cff8 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:41 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-44b16ea0-46b1-43da-8007-85e6e3d797e8 1073741824" returned: 0 in 0.500s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:41 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-44b16ea0-46b1-43da-8007-85e6e3d797e8 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:42 devstack sudo[108254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-44b16ea0-46b1-43da-8007-85e6e3d797e8
Sep 04 16:09:42 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:42 devstack sudo[108253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04
Sep 04 16:09:42 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:42 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-44b16ea0-46b1-43da-8007-85e6e3d797e8" returned: 0 in 0.263s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:09:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdae8a4c-5d08-44eb-b8d2-31a6fb5bde56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44b16ea0-46b1-43da-8007-85e6e3d797e8', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1587377d-d7f1-4215-987b-b08f365899af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:42 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Volume volume-44b16ea0-46b1-43da-8007-85e6e3d797e8 (44b16ea0-46b1-43da-8007-85e6e3d797e8): created successfully
Sep 04 16:09:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1587377d-d7f1-4215-987b-b08f365899af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:42 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Flow 'volume_create_manager' (4770eed0-0dfe-4ecb-b4ea-16068235569f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:42 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-725ab7c0-a7e7-4379-91f7-fb1929d213f2 tempest-ProjectReaderTests-1904542961 None] Created volume successfully.
Sep 04 16:09:42 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-54bce6bb-5a1b-4069-86e5-ec1aa757cff8 tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04" returned: 0 in 0.408s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-54bce6bb-5a1b-4069-86e5-ec1aa757cff8 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:42 devstack sudo[108261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04
Sep 04 16:09:42 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:42 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-54bce6bb-5a1b-4069-86e5-ec1aa757cff8 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-902d95e4-649d-49cd-9ceb-da58e6062f04" returned: 0 in 0.244s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:42 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-54bce6bb-5a1b-4069-86e5-ec1aa757cff8 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-902d95e4-649d-49cd-9ceb-da58e6062f04" released by "delete_volume" :: held 0.714s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:42 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-54bce6bb-5a1b-4069-86e5-ec1aa757cff8 tempest-ProjectMemberTests-369224070 None] Created reservations ['85a77d3a-2b91-4291-8c17-60eb1bb3bff1', 'd7528519-6f3e-4200-a228-0b82c6a66408', 'c69717d2-1dd7-4697-8ed2-08c9370c3d32', '5bd38c78-c46a-42e4-bc64-774f459f9f4a'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:09:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-54bce6bb-5a1b-4069-86e5-ec1aa757cff8 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-54bce6bb-5a1b-4069-86e5-ec1aa757cff8 tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-54bce6bb-5a1b-4069-86e5-ec1aa757cff8 tempest-ProjectMemberTests-369224070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:42 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-54bce6bb-5a1b-4069-86e5-ec1aa757cff8 tempest-ProjectMemberTests-369224070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-54bce6bb-5a1b-4069-86e5-ec1aa757cff8 tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-54bce6bb-5a1b-4069-86e5-ec1aa757cff8 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:42 devstack sudo[108264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:09:42 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:42 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:42 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-54bce6bb-5a1b-4069-86e5-ec1aa757cff8 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.251s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:42 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-54bce6bb-5a1b-4069-86e5-ec1aa757cff8 tempest-ProjectMemberTests-369224070 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:09:42 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-54bce6bb-5a1b-4069-86e5-ec1aa757cff8 tempest-ProjectMemberTests-369224070 None] Deleted volume successfully.
Sep 04 16:09:42 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-54bce6bb-5a1b-4069-86e5-ec1aa757cff8 tempest-ProjectMemberTests-369224070 None] Lock "cinder-902d95e4-649d-49cd-9ceb-da58e6062f04-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Flow 'volume_create_manager' (41c4f0a5-ceb8-4b4f-bfda-2a0dcd7bc042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed9f1f9-040d-4695-8a2a-82518d6b5f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed9f1f9-040d-4695-8a2a-82518d6b5f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2034287709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9884f484-d192-4ca6-b9d4-f71088649f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3bec3eae6a463fbbef6576bb85077b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:43Z,use_quota=True,user_id='fccb6cabb20d46fa8276df523be9732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a8cb1a-a1b5-4625-aad0-0156bd8c56b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a8cb1a-a1b5-4625-aad0-0156bd8c56b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f70b6c4-570d-41cc-901e-1e9e257de071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f70b6c4-570d-41cc-901e-1e9e257de071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9884f484-d192-4ca6-b9d4-f71088649f5e', 'volume_name': 'volume-9884f484-d192-4ca6-b9d4-f71088649f5e', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05aa8fa8-ef9c-4964-9fbe-9b88aea175b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05aa8fa8-ef9c-4964-9fbe-9b88aea175b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c18e60-419c-4371-82f5-6a8995851e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:43 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Volume 9884f484-d192-4ca6-b9d4-f71088649f5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9884f484-d192-4ca6-b9d4-f71088649f5e', 'volume_size': 1}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2034287709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9884f484-d192-4ca6-b9d4-f71088649f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3bec3eae6a463fbbef6576bb85077b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:43Z,use_quota=True,user_id='fccb6cabb20d46fa8276df523be9732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Creating volume 9884f484-d192-4ca6-b9d4-f71088649f5e {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:09:43 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3cec6fc6-1bef-4eca-b506-0ab88c5d4bec tempest-ProjectReaderTests-1904542961 None] Acquiring lock "cinder-44b16ea0-46b1-43da-8007-85e6e3d797e8-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:43 devstack sudo[108267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e 1073741824
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3cec6fc6-1bef-4eca-b506-0ab88c5d4bec tempest-ProjectReaderTests-1904542961 None] Lock "cinder-44b16ea0-46b1-43da-8007-85e6e3d797e8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:43 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3cec6fc6-1bef-4eca-b506-0ab88c5d4bec tempest-ProjectReaderTests-1904542961 None] Acquiring lock "cinder-quobyte-44b16ea0-46b1-43da-8007-85e6e3d797e8" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3cec6fc6-1bef-4eca-b506-0ab88c5d4bec tempest-ProjectReaderTests-1904542961 None] Lock "cinder-quobyte-44b16ea0-46b1-43da-8007-85e6e3d797e8" acquired by "delete_volume" :: waited 0.015s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8219437a-58ab-4abe-9870-8f3cb9194723]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3cec6fc6-1bef-4eca-b506-0ab88c5d4bec tempest-ProjectReaderTests-1904542961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-44b16ea0-46b1-43da-8007-85e6e3d797e8 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:43 devstack sudo[108269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-44b16ea0-46b1-43da-8007-85e6e3d797e8
Sep 04 16:09:43 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:43 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e 1073741824" returned: 0 in 0.436s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:43 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:44 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:44 devstack sudo[108277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e
Sep 04 16:09:44 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3cec6fc6-1bef-4eca-b506-0ab88c5d4bec tempest-ProjectReaderTests-1904542961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-44b16ea0-46b1-43da-8007-85e6e3d797e8" returned: 0 in 0.412s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3cec6fc6-1bef-4eca-b506-0ab88c5d4bec tempest-ProjectReaderTests-1904542961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-44b16ea0-46b1-43da-8007-85e6e3d797e8 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:44 devstack sudo[108279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-44b16ea0-46b1-43da-8007-85e6e3d797e8
Sep 04 16:09:44 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:44 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3cec6fc6-1bef-4eca-b506-0ab88c5d4bec tempest-ProjectReaderTests-1904542961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-44b16ea0-46b1-43da-8007-85e6e3d797e8" returned: 0 in 0.270s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:44 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e" returned: 0 in 0.322s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:09:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3cec6fc6-1bef-4eca-b506-0ab88c5d4bec tempest-ProjectReaderTests-1904542961 None] Lock "cinder-quobyte-44b16ea0-46b1-43da-8007-85e6e3d797e8" released by "delete_volume" :: held 0.733s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c18e60-419c-4371-82f5-6a8995851e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9884f484-d192-4ca6-b9d4-f71088649f5e', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320816f5-18ad-4d69-8bf1-0f752005b00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:44 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Volume volume-9884f484-d192-4ca6-b9d4-f71088649f5e (9884f484-d192-4ca6-b9d4-f71088649f5e): created successfully
Sep 04 16:09:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320816f5-18ad-4d69-8bf1-0f752005b00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:44 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Flow 'volume_create_manager' (41c4f0a5-ceb8-4b4f-bfda-2a0dcd7bc042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:44 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-6c97e438-76bb-4255-8ce3-3946412ffa9d tempest-ProjectMemberTests-369224070 None] Created volume successfully.
Sep 04 16:09:44 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-3cec6fc6-1bef-4eca-b506-0ab88c5d4bec tempest-ProjectReaderTests-1904542961 None] Created reservations ['87f09bbc-85f8-4185-af07-46667ef54c52', 'a513f484-d6c9-4304-a4a2-3abd1e01282e', '1658f1f7-7b3a-49a0-ba63-54ee235ca707', '0e6e8929-e3b2-4160-aebf-4ce07deb63fb'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:09:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3cec6fc6-1bef-4eca-b506-0ab88c5d4bec tempest-ProjectReaderTests-1904542961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3cec6fc6-1bef-4eca-b506-0ab88c5d4bec tempest-ProjectReaderTests-1904542961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3cec6fc6-1bef-4eca-b506-0ab88c5d4bec tempest-ProjectReaderTests-1904542961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:44 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3cec6fc6-1bef-4eca-b506-0ab88c5d4bec tempest-ProjectReaderTests-1904542961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3cec6fc6-1bef-4eca-b506-0ab88c5d4bec tempest-ProjectReaderTests-1904542961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3cec6fc6-1bef-4eca-b506-0ab88c5d4bec tempest-ProjectReaderTests-1904542961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:44 devstack sudo[108283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:09:44 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:44 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:44 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3cec6fc6-1bef-4eca-b506-0ab88c5d4bec tempest-ProjectReaderTests-1904542961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.287s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:44 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-3cec6fc6-1bef-4eca-b506-0ab88c5d4bec tempest-ProjectReaderTests-1904542961 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:09:44 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-3cec6fc6-1bef-4eca-b506-0ab88c5d4bec tempest-ProjectReaderTests-1904542961 None] Deleted volume successfully.
Sep 04 16:09:44 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3cec6fc6-1bef-4eca-b506-0ab88c5d4bec tempest-ProjectReaderTests-1904542961 None] Lock "cinder-44b16ea0-46b1-43da-8007-85e6e3d797e8-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f090fc83-6634-46a0-90b2-a3b1f0beba8c tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f090fc83-6634-46a0-90b2-a3b1f0beba8c tempest-ProjectMemberTests-369224070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:45 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-f090fc83-6634-46a0-90b2-a3b1f0beba8c tempest-ProjectMemberTests-369224070 None] Creating offline snapshot 302fd0bb-af9b-45f9-9c1a-9a7df1519171 of volume 9884f484-d192-4ca6-b9d4-f71088649f5e {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 16:09:45 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4eaa341-24fe-42f8-b760-ba7ea003d566]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:45 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f090fc83-6634-46a0-90b2-a3b1f0beba8c tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:45 devstack sudo[108287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e
Sep 04 16:09:45 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:46 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f090fc83-6634-46a0-90b2-a3b1f0beba8c tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e" returned: 0 in 0.428s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f090fc83-6634-46a0-90b2-a3b1f0beba8c tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.302fd0bb-af9b-45f9-9c1a-9a7df1519171 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:46 devstack sudo[108294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.302fd0bb-af9b-45f9-9c1a-9a7df1519171 1G
Sep 04 16:09:46 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:46 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f090fc83-6634-46a0-90b2-a3b1f0beba8c tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.302fd0bb-af9b-45f9-9c1a-9a7df1519171 1G" returned: 0 in 0.472s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f090fc83-6634-46a0-90b2-a3b1f0beba8c tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9884f484-d192-4ca6-b9d4-f71088649f5e -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.302fd0bb-af9b-45f9-9c1a-9a7df1519171 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:46 devstack sudo[108299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9884f484-d192-4ca6-b9d4-f71088649f5e -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.302fd0bb-af9b-45f9-9c1a-9a7df1519171
Sep 04 16:09:46 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:46 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f090fc83-6634-46a0-90b2-a3b1f0beba8c tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9884f484-d192-4ca6-b9d4-f71088649f5e -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.302fd0bb-af9b-45f9-9c1a-9a7df1519171" returned: 0 in 0.349s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:46 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-f090fc83-6634-46a0-90b2-a3b1f0beba8c tempest-ProjectMemberTests-369224070 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.302fd0bb-af9b-45f9-9c1a-9a7df1519171 is being set with open permissions: ugo+rw
Sep 04 16:09:46 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f090fc83-6634-46a0-90b2-a3b1f0beba8c tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.302fd0bb-af9b-45f9-9c1a-9a7df1519171 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:47 devstack sudo[108306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.302fd0bb-af9b-45f9-9c1a-9a7df1519171
Sep 04 16:09:47 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:47 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f090fc83-6634-46a0-90b2-a3b1f0beba8c tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.302fd0bb-af9b-45f9-9c1a-9a7df1519171" returned: 0 in 0.261s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f090fc83-6634-46a0-90b2-a3b1f0beba8c tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:47 devstack sudo[108309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.info
Sep 04 16:09:47 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:47 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f090fc83-6634-46a0-90b2-a3b1f0beba8c tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.info" returned: 0 in 0.249s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:47 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-f090fc83-6634-46a0-90b2-a3b1f0beba8c tempest-ProjectMemberTests-369224070 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.info is being set with open permissions: ugo+rw
Sep 04 16:09:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f090fc83-6634-46a0-90b2-a3b1f0beba8c tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:47 devstack sudo[108312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.info
Sep 04 16:09:47 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:47 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f090fc83-6634-46a0-90b2-a3b1f0beba8c tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.info" returned: 0 in 0.237s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:47 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f090fc83-6634-46a0-90b2-a3b1f0beba8c tempest-ProjectMemberTests-369224070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.082s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:47 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f090fc83-6634-46a0-90b2-a3b1f0beba8c tempest-ProjectMemberTests-369224070 None] Create snapshot completed successfully
Sep 04 16:09:48 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 16:09:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:48 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-00892a6f-9e0e-4d48-86b5-7675ebaa66bd tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-302fd0bb-af9b-45f9-9c1a-9a7df1519171-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:48 devstack sudo[108315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:09:48 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:48 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-00892a6f-9e0e-4d48-86b5-7675ebaa66bd tempest-ProjectMemberTests-369224070 None] Lock "cinder-302fd0bb-af9b-45f9-9c1a-9a7df1519171-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:48 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-00892a6f-9e0e-4d48-86b5-7675ebaa66bd tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-9884f484-d192-4ca6-b9d4-f71088649f5e" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:48 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-00892a6f-9e0e-4d48-86b5-7675ebaa66bd tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-9884f484-d192-4ca6-b9d4-f71088649f5e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:48 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-00892a6f-9e0e-4d48-86b5-7675ebaa66bd tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-302fd0bb-af9b-45f9-9c1a-9a7df1519171" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:48 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-00892a6f-9e0e-4d48-86b5-7675ebaa66bd tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-302fd0bb-af9b-45f9-9c1a-9a7df1519171" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-00892a6f-9e0e-4d48-86b5-7675ebaa66bd tempest-ProjectMemberTests-369224070 None] Deleting offline snapshot 302fd0bb-af9b-45f9-9c1a-9a7df1519171 of volume 9884f484-d192-4ca6-b9d4-f71088649f5e {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 16:09:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-00892a6f-9e0e-4d48-86b5-7675ebaa66bd tempest-ProjectMemberTests-369224070 None] snapshot_file for this snap is: volume-9884f484-d192-4ca6-b9d4-f71088649f5e.302fd0bb-af9b-45f9-9c1a-9a7df1519171 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 16:09:48 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[26acf4d3-422b-4867-8b25-e3f829eaf42a]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-00892a6f-9e0e-4d48-86b5-7675ebaa66bd tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.302fd0bb-af9b-45f9-9c1a-9a7df1519171 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:49 devstack sudo[108317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.302fd0bb-af9b-45f9-9c1a-9a7df1519171
Sep 04 16:09:49 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:49 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.299s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:49 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:09:49 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager._thread_info {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 16:09:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread count: 28 {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 16:09:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread info: [<_MainThread(MainThread, started 131673838448768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131673724603200)>, <Thread(Thread-3 (stat_writer), started daemon 131673723495936)>, <Thread(Rabbit-heartbeat, started daemon 131673723764800)>, <Thread(Thread-5 (_runner), started daemon 131673722269632)>, <Thread(Thread-7 (_runner), started daemon 131673722322112)>, <Thread(fd_logger, started daemon 131673722585024)>, <Thread(privsep_reader, started daemon 131673721593984)>, <Thread(tpool_thread_0, started daemon 131673714706112)>, <Thread(tpool_thread_1, started daemon 131673706313408)>, <Thread(tpool_thread_2, started daemon 131673697920704)>, <Thread(tpool_thread_3, started daemon 131673689528000)>, <Thread(tpool_thread_4, started daemon 131673681135296)>, <Thread(tpool_thread_5, started daemon 131673672726208)>, <Thread(tpool_thread_6, started daemon 131673664317120)>, <Thread(tpool_thread_7, started daemon 131673655908032)>, <Thread(tpool_thread_8, started daemon 131673647498944)>, <Thread(tpool_thread_9, started daemon 131673639089856)>, <Thread(tpool_thread_10, started daemon 131673630680768)>, <Thread(tpool_thread_11, started daemon 131673622271680)>, <Thread(tpool_thread_12, started daemon 131673613862592)>, <Thread(tpool_thread_13, started daemon 131673605453504)>, <Thread(tpool_thread_14, started daemon 131673597044416)>, <Thread(tpool_thread_15, started daemon 131673588635328)>, <Thread(tpool_thread_16, started daemon 131673580226240)>, <Thread(tpool_thread_17, started daemon 131673571817152)>, <Thread(tpool_thread_18, started daemon 131673563408064)>, <Thread(tpool_thread_19, started daemon 131673554998976)>] {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 16:09:49 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-00892a6f-9e0e-4d48-86b5-7675ebaa66bd tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.302fd0bb-af9b-45f9-9c1a-9a7df1519171" returned: 0 in 0.381s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:49 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-00892a6f-9e0e-4d48-86b5-7675ebaa66bd tempest-ProjectMemberTests-369224070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9884f484-d192-4ca6-b9d4-f71088649f5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:09:49 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a490d39-30d8-4f93-8818-cdc104e74907]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-00892a6f-9e0e-4d48-86b5-7675ebaa66bd tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:49 devstack sudo[108323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e
Sep 04 16:09:49 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:49 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-00892a6f-9e0e-4d48-86b5-7675ebaa66bd tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e" returned: 0 in 0.355s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-00892a6f-9e0e-4d48-86b5-7675ebaa66bd tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.302fd0bb-af9b-45f9-9c1a-9a7df1519171 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:49 devstack sudo[108328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.302fd0bb-af9b-45f9-9c1a-9a7df1519171
Sep 04 16:09:49 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:50 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-00892a6f-9e0e-4d48-86b5-7675ebaa66bd tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.302fd0bb-af9b-45f9-9c1a-9a7df1519171" returned: 0 in 0.322s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-00892a6f-9e0e-4d48-86b5-7675ebaa66bd tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.302fd0bb-af9b-45f9-9c1a-9a7df1519171 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:50 devstack sudo[108333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.302fd0bb-af9b-45f9-9c1a-9a7df1519171
Sep 04 16:09:50 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:50 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:50 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-00892a6f-9e0e-4d48-86b5-7675ebaa66bd tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e.302fd0bb-af9b-45f9-9c1a-9a7df1519171" returned: 0 in 0.236s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-00892a6f-9e0e-4d48-86b5-7675ebaa66bd tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-302fd0bb-af9b-45f9-9c1a-9a7df1519171" released by "_delete_snapshot" :: held 1.385s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-00892a6f-9e0e-4d48-86b5-7675ebaa66bd tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-9884f484-d192-4ca6-b9d4-f71088649f5e" released by "delete_snapshot" :: held 1.409s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:50 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-00892a6f-9e0e-4d48-86b5-7675ebaa66bd tempest-ProjectMemberTests-369224070 None] Created reservations ['b769915f-67e8-4d35-bd8b-0f99779de867', '206e6b78-a1c5-4bbb-983e-6ea1c7ca25a9', 'deaca365-776d-4f8f-ae07-edc1e334b671', '44aa9c16-706f-4b02-8875-3672e336e09a'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:09:50 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-00892a6f-9e0e-4d48-86b5-7675ebaa66bd tempest-ProjectMemberTests-369224070 None] Delete snapshot completed successfully.
Sep 04 16:09:50 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-00892a6f-9e0e-4d48-86b5-7675ebaa66bd tempest-ProjectMemberTests-369224070 None] Lock "cinder-302fd0bb-af9b-45f9-9c1a-9a7df1519171-delete_snapshot" released by "delete_snapshot" :: held 1.567s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b20256c9-bc03-4cd2-9768-31214261d440 tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-9884f484-d192-4ca6-b9d4-f71088649f5e-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b20256c9-bc03-4cd2-9768-31214261d440 tempest-ProjectMemberTests-369224070 None] Lock "cinder-9884f484-d192-4ca6-b9d4-f71088649f5e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b20256c9-bc03-4cd2-9768-31214261d440 tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-9884f484-d192-4ca6-b9d4-f71088649f5e" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b20256c9-bc03-4cd2-9768-31214261d440 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-9884f484-d192-4ca6-b9d4-f71088649f5e" acquired by "delete_volume" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:51 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c8edec-5540-417f-9566-96cc5cef01fe]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b20256c9-bc03-4cd2-9768-31214261d440 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:51 devstack sudo[108337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e
Sep 04 16:09:51 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:51 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b20256c9-bc03-4cd2-9768-31214261d440 tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e" returned: 0 in 0.358s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b20256c9-bc03-4cd2-9768-31214261d440 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:51 devstack sudo[108342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e
Sep 04 16:09:51 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:51 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b20256c9-bc03-4cd2-9768-31214261d440 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-9884f484-d192-4ca6-b9d4-f71088649f5e" returned: 0 in 0.237s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:51 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b20256c9-bc03-4cd2-9768-31214261d440 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-9884f484-d192-4ca6-b9d4-f71088649f5e" released by "delete_volume" :: held 0.653s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:51 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-b20256c9-bc03-4cd2-9768-31214261d440 tempest-ProjectMemberTests-369224070 None] Created reservations ['ca0de3e2-b420-4996-a986-a760e62ad3e3', '83f943de-084c-4d9a-b614-efc08b5411b8', '7afb5c29-1650-4bcb-8e7b-373019c217e8', 'd4881f00-41f1-491f-92a8-645c17ea5470'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:09:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b20256c9-bc03-4cd2-9768-31214261d440 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b20256c9-bc03-4cd2-9768-31214261d440 tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:51 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b20256c9-bc03-4cd2-9768-31214261d440 tempest-ProjectMemberTests-369224070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:51 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-b20256c9-bc03-4cd2-9768-31214261d440 tempest-ProjectMemberTests-369224070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-b20256c9-bc03-4cd2-9768-31214261d440 tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:51 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b20256c9-bc03-4cd2-9768-31214261d440 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:51 devstack sudo[108345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:09:51 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:52 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-b20256c9-bc03-4cd2-9768-31214261d440 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.246s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:52 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-b20256c9-bc03-4cd2-9768-31214261d440 tempest-ProjectMemberTests-369224070 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:09:52 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-b20256c9-bc03-4cd2-9768-31214261d440 tempest-ProjectMemberTests-369224070 None] Deleted volume successfully.
Sep 04 16:09:52 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-b20256c9-bc03-4cd2-9768-31214261d440 tempest-ProjectMemberTests-369224070 None] Lock "cinder-9884f484-d192-4ca6-b9d4-f71088649f5e-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:52 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:09:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Flow 'volume_create_manager' (ea63ea2a-4438-425e-9c4d-7ed1606cda07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b25fd5-addc-4689-b17c-63232e13744c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b25fd5-addc-4689-b17c-63232e13744c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1701224907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee635fd9-165e-4551-85f7-d9f36d949ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3bec3eae6a463fbbef6576bb85077b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:53Z,use_quota=True,user_id='fccb6cabb20d46fa8276df523be9732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8414cb33-f8de-4e6b-a34c-3734a198a02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8414cb33-f8de-4e6b-a34c-3734a198a02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1c28412-63c0-496a-8c07-984b0efb2b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1c28412-63c0-496a-8c07-984b0efb2b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee635fd9-165e-4551-85f7-d9f36d949ab7', 'volume_name': 'volume-ee635fd9-165e-4551-85f7-d9f36d949ab7', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29036af2-1bf1-48c5-8e56-c11d8e4a6a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29036af2-1bf1-48c5-8e56-c11d8e4a6a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:52 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a8cc76d-266d-4bc9-9b91-380e2e92535f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:52 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Volume ee635fd9-165e-4551-85f7-d9f36d949ab7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee635fd9-165e-4551-85f7-d9f36d949ab7', 'volume_size': 1}
Sep 04 16:09:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:52 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1701224907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee635fd9-165e-4551-85f7-d9f36d949ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3bec3eae6a463fbbef6576bb85077b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:53Z,use_quota=True,user_id='fccb6cabb20d46fa8276df523be9732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:09:52 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Creating volume ee635fd9-165e-4551-85f7-d9f36d949ab7 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:09:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:52 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:52 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:52 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:09:52 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:09:52 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:52 devstack sudo[108348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7 1073741824
Sep 04 16:09:52 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:53 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7 1073741824" returned: 0 in 0.462s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:53 devstack sudo[108353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7
Sep 04 16:09:53 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:53 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7" returned: 0 in 0.249s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:09:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a8cc76d-266d-4bc9-9b91-380e2e92535f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee635fd9-165e-4551-85f7-d9f36d949ab7', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6779b4-4262-4dfa-9127-728e206c03e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:53 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Volume volume-ee635fd9-165e-4551-85f7-d9f36d949ab7 (ee635fd9-165e-4551-85f7-d9f36d949ab7): created successfully
Sep 04 16:09:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6779b4-4262-4dfa-9127-728e206c03e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:53 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Flow 'volume_create_manager' (ea63ea2a-4438-425e-9c4d-7ed1606cda07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:53 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f25d44ba-9293-4e66-9f17-ce552d065d50 tempest-ProjectMemberTests-369224070 None] Created volume successfully.
Sep 04 16:09:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bfa9fc6b-70ea-4ce2-8a73-f9393449ca17 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bfa9fc6b-70ea-4ce2-8a73-f9393449ca17 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:53 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-bfa9fc6b-70ea-4ce2-8a73-f9393449ca17 tempest-ProjectMemberTests-369224070 None] Creating offline snapshot 81940c1c-6c74-49df-9de9-65ed9e7774d7 of volume ee635fd9-165e-4551-85f7-d9f36d949ab7 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 16:09:53 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0203288-2852-4647-8e9d-7313d7343333]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:53 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bfa9fc6b-70ea-4ce2-8a73-f9393449ca17 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:54 devstack sudo[108356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7
Sep 04 16:09:54 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:54 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bfa9fc6b-70ea-4ce2-8a73-f9393449ca17 tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7" returned: 0 in 0.362s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bfa9fc6b-70ea-4ce2-8a73-f9393449ca17 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.81940c1c-6c74-49df-9de9-65ed9e7774d7 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:54 devstack sudo[108361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.81940c1c-6c74-49df-9de9-65ed9e7774d7 1G
Sep 04 16:09:54 devstack sudo[108361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:54 devstack sudo[108361]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bfa9fc6b-70ea-4ce2-8a73-f9393449ca17 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.81940c1c-6c74-49df-9de9-65ed9e7774d7 1G" returned: 0 in 0.444s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:54 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bfa9fc6b-70ea-4ce2-8a73-f9393449ca17 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee635fd9-165e-4551-85f7-d9f36d949ab7 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.81940c1c-6c74-49df-9de9-65ed9e7774d7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:54 devstack sudo[108367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee635fd9-165e-4551-85f7-d9f36d949ab7 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.81940c1c-6c74-49df-9de9-65ed9e7774d7
Sep 04 16:09:54 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:55 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bfa9fc6b-70ea-4ce2-8a73-f9393449ca17 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee635fd9-165e-4551-85f7-d9f36d949ab7 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.81940c1c-6c74-49df-9de9-65ed9e7774d7" returned: 0 in 0.312s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:55 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-bfa9fc6b-70ea-4ce2-8a73-f9393449ca17 tempest-ProjectMemberTests-369224070 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.81940c1c-6c74-49df-9de9-65ed9e7774d7 is being set with open permissions: ugo+rw
Sep 04 16:09:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bfa9fc6b-70ea-4ce2-8a73-f9393449ca17 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.81940c1c-6c74-49df-9de9-65ed9e7774d7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:55 devstack sudo[108372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.81940c1c-6c74-49df-9de9-65ed9e7774d7
Sep 04 16:09:55 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:55 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bfa9fc6b-70ea-4ce2-8a73-f9393449ca17 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.81940c1c-6c74-49df-9de9-65ed9e7774d7" returned: 0 in 0.244s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bfa9fc6b-70ea-4ce2-8a73-f9393449ca17 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:55 devstack sudo[108375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.info
Sep 04 16:09:55 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:55 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bfa9fc6b-70ea-4ce2-8a73-f9393449ca17 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.info" returned: 0 in 0.260s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:55 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-bfa9fc6b-70ea-4ce2-8a73-f9393449ca17 tempest-ProjectMemberTests-369224070 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.info is being set with open permissions: ugo+rw
Sep 04 16:09:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bfa9fc6b-70ea-4ce2-8a73-f9393449ca17 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:55 devstack sudo[108378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.info
Sep 04 16:09:55 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:55 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-bfa9fc6b-70ea-4ce2-8a73-f9393449ca17 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.info" returned: 0 in 0.237s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:55 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-bfa9fc6b-70ea-4ce2-8a73-f9393449ca17 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.948s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:55 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-bfa9fc6b-70ea-4ce2-8a73-f9393449ca17 tempest-ProjectMemberTests-369224070 None] Create snapshot completed successfully
Sep 04 16:09:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f7b70312-d5a1-4351-9b0c-9fc082c93cdc tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-81940c1c-6c74-49df-9de9-65ed9e7774d7-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f7b70312-d5a1-4351-9b0c-9fc082c93cdc tempest-ProjectMemberTests-369224070 None] Lock "cinder-81940c1c-6c74-49df-9de9-65ed9e7774d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f7b70312-d5a1-4351-9b0c-9fc082c93cdc tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-ee635fd9-165e-4551-85f7-d9f36d949ab7" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f7b70312-d5a1-4351-9b0c-9fc082c93cdc tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-ee635fd9-165e-4551-85f7-d9f36d949ab7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f7b70312-d5a1-4351-9b0c-9fc082c93cdc tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-81940c1c-6c74-49df-9de9-65ed9e7774d7" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:56 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f7b70312-d5a1-4351-9b0c-9fc082c93cdc tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-81940c1c-6c74-49df-9de9-65ed9e7774d7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-f7b70312-d5a1-4351-9b0c-9fc082c93cdc tempest-ProjectMemberTests-369224070 None] Deleting offline snapshot 81940c1c-6c74-49df-9de9-65ed9e7774d7 of volume ee635fd9-165e-4551-85f7-d9f36d949ab7 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 16:09:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-f7b70312-d5a1-4351-9b0c-9fc082c93cdc tempest-ProjectMemberTests-369224070 None] snapshot_file for this snap is: volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.81940c1c-6c74-49df-9de9-65ed9e7774d7 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 16:09:56 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9774e9-3ab5-420f-ac90-9ca722b91a18]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f7b70312-d5a1-4351-9b0c-9fc082c93cdc tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.81940c1c-6c74-49df-9de9-65ed9e7774d7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:56 devstack sudo[108381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.81940c1c-6c74-49df-9de9-65ed9e7774d7
Sep 04 16:09:56 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:56 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f7b70312-d5a1-4351-9b0c-9fc082c93cdc tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.81940c1c-6c74-49df-9de9-65ed9e7774d7" returned: 0 in 0.374s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:56 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-f7b70312-d5a1-4351-9b0c-9fc082c93cdc tempest-ProjectMemberTests-369224070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee635fd9-165e-4551-85f7-d9f36d949ab7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:09:56 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be095eb-5ed5-451c-9ff6-a515ae2dd29d]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f7b70312-d5a1-4351-9b0c-9fc082c93cdc tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:56 devstack sudo[108386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7
Sep 04 16:09:56 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:56 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f7b70312-d5a1-4351-9b0c-9fc082c93cdc tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7" returned: 0 in 0.362s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:56 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f7b70312-d5a1-4351-9b0c-9fc082c93cdc tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.81940c1c-6c74-49df-9de9-65ed9e7774d7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:56 devstack sudo[108391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.81940c1c-6c74-49df-9de9-65ed9e7774d7
Sep 04 16:09:56 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:57 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f7b70312-d5a1-4351-9b0c-9fc082c93cdc tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.81940c1c-6c74-49df-9de9-65ed9e7774d7" returned: 0 in 0.350s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f7b70312-d5a1-4351-9b0c-9fc082c93cdc tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.81940c1c-6c74-49df-9de9-65ed9e7774d7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:57 devstack sudo[108396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.81940c1c-6c74-49df-9de9-65ed9e7774d7
Sep 04 16:09:57 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:57 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:57 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-f7b70312-d5a1-4351-9b0c-9fc082c93cdc tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7.81940c1c-6c74-49df-9de9-65ed9e7774d7" returned: 0 in 0.297s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f7b70312-d5a1-4351-9b0c-9fc082c93cdc tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-81940c1c-6c74-49df-9de9-65ed9e7774d7" released by "_delete_snapshot" :: held 1.479s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f7b70312-d5a1-4351-9b0c-9fc082c93cdc tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-ee635fd9-165e-4551-85f7-d9f36d949ab7" released by "delete_snapshot" :: held 1.503s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:57 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-f7b70312-d5a1-4351-9b0c-9fc082c93cdc tempest-ProjectMemberTests-369224070 None] Created reservations ['978c6af0-d3ec-4168-b8a6-a5b0afad1f4f', 'aa27c75e-a76a-4956-a489-6564582c6389', 'd2eaa426-f899-4b64-ac15-d5df07b3a4f6', '022629b4-6211-431b-8663-4dd3d9a10d1e'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:09:57 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-f7b70312-d5a1-4351-9b0c-9fc082c93cdc tempest-ProjectMemberTests-369224070 None] Delete snapshot completed successfully.
Sep 04 16:09:57 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-f7b70312-d5a1-4351-9b0c-9fc082c93cdc tempest-ProjectMemberTests-369224070 None] Lock "cinder-81940c1c-6c74-49df-9de9-65ed9e7774d7-delete_snapshot" released by "delete_snapshot" :: held 1.657s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:58 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3716c52e-d8a1-4578-ae03-b27caaf6d469 tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-ee635fd9-165e-4551-85f7-d9f36d949ab7-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:58 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3716c52e-d8a1-4578-ae03-b27caaf6d469 tempest-ProjectMemberTests-369224070 None] Lock "cinder-ee635fd9-165e-4551-85f7-d9f36d949ab7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:58 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3716c52e-d8a1-4578-ae03-b27caaf6d469 tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-ee635fd9-165e-4551-85f7-d9f36d949ab7" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:09:58 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3716c52e-d8a1-4578-ae03-b27caaf6d469 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-ee635fd9-165e-4551-85f7-d9f36d949ab7" acquired by "delete_volume" :: waited 0.023s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:09:58 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab3be51-6b49-4365-9f3e-c5d5279c1fd3]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:09:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3716c52e-d8a1-4578-ae03-b27caaf6d469 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:58 devstack sudo[108399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7
Sep 04 16:09:58 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:58 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3716c52e-d8a1-4578-ae03-b27caaf6d469 tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7" returned: 0 in 0.382s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3716c52e-d8a1-4578-ae03-b27caaf6d469 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:58 devstack sudo[108404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7
Sep 04 16:09:58 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:58 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:58 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3716c52e-d8a1-4578-ae03-b27caaf6d469 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-ee635fd9-165e-4551-85f7-d9f36d949ab7" returned: 0 in 0.254s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:58 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3716c52e-d8a1-4578-ae03-b27caaf6d469 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-ee635fd9-165e-4551-85f7-d9f36d949ab7" released by "delete_volume" :: held 0.692s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-3716c52e-d8a1-4578-ae03-b27caaf6d469 tempest-ProjectMemberTests-369224070 None] Created reservations ['58e76644-e595-4b6d-afd4-08488f2b4865', '8cbc894d-1276-4642-ab75-d71316d2dd78', 'c833cd0d-ffcc-4e57-b70b-1428db7293b4', '9a420227-2f5d-4438-b1e3-cb1f2b6e498d'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3716c52e-d8a1-4578-ae03-b27caaf6d469 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3716c52e-d8a1-4578-ae03-b27caaf6d469 tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3716c52e-d8a1-4578-ae03-b27caaf6d469 tempest-ProjectMemberTests-369224070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-3716c52e-d8a1-4578-ae03-b27caaf6d469 tempest-ProjectMemberTests-369224070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-3716c52e-d8a1-4578-ae03-b27caaf6d469 tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3716c52e-d8a1-4578-ae03-b27caaf6d469 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:59 devstack sudo[108407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:09:59 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:09:59 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3716c52e-d8a1-4578-ae03-b27caaf6d469 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.264s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-3716c52e-d8a1-4578-ae03-b27caaf6d469 tempest-ProjectMemberTests-369224070 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:09:59 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-3716c52e-d8a1-4578-ae03-b27caaf6d469 tempest-ProjectMemberTests-369224070 None] Deleted volume successfully.
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3716c52e-d8a1-4578-ae03-b27caaf6d469 tempest-ProjectMemberTests-369224070 None] Lock "cinder-ee635fd9-165e-4551-85f7-d9f36d949ab7-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Flow 'volume_create_manager' (90128b17-964b-4eae-818c-9236e5f3877b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd28ad4-9306-45f1-bb4d-1e77f518a225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd28ad4-9306-45f1-bb4d-1e77f518a225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2009512125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a24d117e-e684-4921-a3d2-0d14df0e6842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3bec3eae6a463fbbef6576bb85077b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:00Z,use_quota=True,user_id='fccb6cabb20d46fa8276df523be9732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (667cb6db-ba81-4260-ae88-34a9547f372a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (667cb6db-ba81-4260-ae88-34a9547f372a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6283febf-41ed-4414-bd14-80fb8aff2918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6283febf-41ed-4414-bd14-80fb8aff2918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a24d117e-e684-4921-a3d2-0d14df0e6842', 'volume_name': 'volume-a24d117e-e684-4921-a3d2-0d14df0e6842', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c075e4-a656-49e9-984b-56cfbb15c122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c075e4-a656-49e9-984b-56cfbb15c122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51ed85d6-9167-41bb-b25b-80bac9a55641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:09:59 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Volume a24d117e-e684-4921-a3d2-0d14df0e6842: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a24d117e-e684-4921-a3d2-0d14df0e6842', 'volume_size': 1}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2009512125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a24d117e-e684-4921-a3d2-0d14df0e6842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3bec3eae6a463fbbef6576bb85077b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:00Z,use_quota=True,user_id='fccb6cabb20d46fa8276df523be9732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Creating volume a24d117e-e684-4921-a3d2-0d14df0e6842 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:09:59 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:09:59 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:09:59 devstack sudo[108410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842 1073741824
Sep 04 16:09:59 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:00 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842 1073741824" returned: 0 in 0.402s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:00 devstack sudo[108415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842
Sep 04 16:10:00 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:00 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842" returned: 0 in 0.249s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:00 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:10:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:10:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51ed85d6-9167-41bb-b25b-80bac9a55641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a24d117e-e684-4921-a3d2-0d14df0e6842', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:10:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b307e990-2e0b-4833-a8dd-f680c7130e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:10:00 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Volume volume-a24d117e-e684-4921-a3d2-0d14df0e6842 (a24d117e-e684-4921-a3d2-0d14df0e6842): created successfully
Sep 04 16:10:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b307e990-2e0b-4833-a8dd-f680c7130e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:10:00 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Flow 'volume_create_manager' (90128b17-964b-4eae-818c-9236e5f3877b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:10:00 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-11369b6e-5ebd-4b54-a06f-057dc840b041 tempest-ProjectMemberTests-369224070 None] Created volume successfully.
Sep 04 16:10:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-834b1aab-ee19-4d05-954b-371bd32c1439 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:10:00 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-834b1aab-ee19-4d05-954b-371bd32c1439 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:10:01 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-834b1aab-ee19-4d05-954b-371bd32c1439 tempest-ProjectMemberTests-369224070 None] Creating offline snapshot edf59577-c488-4938-b1e6-035766155065 of volume a24d117e-e684-4921-a3d2-0d14df0e6842 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 16:10:01 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[8548569f-c648-4d84-8967-321c2e06e730]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:10:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-834b1aab-ee19-4d05-954b-371bd32c1439 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:01 devstack sudo[108418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842
Sep 04 16:10:01 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:01 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-834b1aab-ee19-4d05-954b-371bd32c1439 tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842" returned: 0 in 0.369s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-834b1aab-ee19-4d05-954b-371bd32c1439 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.edf59577-c488-4938-b1e6-035766155065 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:01 devstack sudo[108423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.edf59577-c488-4938-b1e6-035766155065 1G
Sep 04 16:10:01 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:01 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-834b1aab-ee19-4d05-954b-371bd32c1439 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.edf59577-c488-4938-b1e6-035766155065 1G" returned: 0 in 0.427s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:01 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-834b1aab-ee19-4d05-954b-371bd32c1439 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a24d117e-e684-4921-a3d2-0d14df0e6842 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.edf59577-c488-4938-b1e6-035766155065 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:01 devstack sudo[108428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a24d117e-e684-4921-a3d2-0d14df0e6842 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.edf59577-c488-4938-b1e6-035766155065
Sep 04 16:10:01 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:02 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-834b1aab-ee19-4d05-954b-371bd32c1439 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a24d117e-e684-4921-a3d2-0d14df0e6842 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.edf59577-c488-4938-b1e6-035766155065" returned: 0 in 0.334s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:02 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-834b1aab-ee19-4d05-954b-371bd32c1439 tempest-ProjectMemberTests-369224070 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.edf59577-c488-4938-b1e6-035766155065 is being set with open permissions: ugo+rw
Sep 04 16:10:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-834b1aab-ee19-4d05-954b-371bd32c1439 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.edf59577-c488-4938-b1e6-035766155065 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:02 devstack sudo[108433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.edf59577-c488-4938-b1e6-035766155065
Sep 04 16:10:02 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:02 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-834b1aab-ee19-4d05-954b-371bd32c1439 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.edf59577-c488-4938-b1e6-035766155065" returned: 0 in 0.252s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-834b1aab-ee19-4d05-954b-371bd32c1439 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:02 devstack sudo[108436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.info
Sep 04 16:10:02 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:02 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-834b1aab-ee19-4d05-954b-371bd32c1439 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.info" returned: 0 in 0.262s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:02 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-834b1aab-ee19-4d05-954b-371bd32c1439 tempest-ProjectMemberTests-369224070 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.info is being set with open permissions: ugo+rw
Sep 04 16:10:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-834b1aab-ee19-4d05-954b-371bd32c1439 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:02 devstack sudo[108439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.info
Sep 04 16:10:02 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:02 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:02 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-834b1aab-ee19-4d05-954b-371bd32c1439 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.info" returned: 0 in 0.297s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:03 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-834b1aab-ee19-4d05-954b-371bd32c1439 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.026s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:10:03 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-834b1aab-ee19-4d05-954b-371bd32c1439 tempest-ProjectMemberTests-369224070 None] Create snapshot completed successfully
Sep 04 16:10:04 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2b97976d-f629-4a54-bab7-857c5c9ba42e tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-edf59577-c488-4938-b1e6-035766155065-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:10:04 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2b97976d-f629-4a54-bab7-857c5c9ba42e tempest-ProjectMemberTests-369224070 None] Lock "cinder-edf59577-c488-4938-b1e6-035766155065-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:10:04 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2b97976d-f629-4a54-bab7-857c5c9ba42e tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-a24d117e-e684-4921-a3d2-0d14df0e6842" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:10:04 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2b97976d-f629-4a54-bab7-857c5c9ba42e tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-a24d117e-e684-4921-a3d2-0d14df0e6842" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:10:04 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2b97976d-f629-4a54-bab7-857c5c9ba42e tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-edf59577-c488-4938-b1e6-035766155065" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:10:04 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2b97976d-f629-4a54-bab7-857c5c9ba42e tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-edf59577-c488-4938-b1e6-035766155065" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:10:04 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-2b97976d-f629-4a54-bab7-857c5c9ba42e tempest-ProjectMemberTests-369224070 None] Deleting offline snapshot edf59577-c488-4938-b1e6-035766155065 of volume a24d117e-e684-4921-a3d2-0d14df0e6842 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 16:10:04 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-2b97976d-f629-4a54-bab7-857c5c9ba42e tempest-ProjectMemberTests-369224070 None] snapshot_file for this snap is: volume-a24d117e-e684-4921-a3d2-0d14df0e6842.edf59577-c488-4938-b1e6-035766155065 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 16:10:04 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[537254da-0fa1-475a-ad48-90ecd9a5f4ec]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:10:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b97976d-f629-4a54-bab7-857c5c9ba42e tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.edf59577-c488-4938-b1e6-035766155065 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:04 devstack sudo[108443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.edf59577-c488-4938-b1e6-035766155065
Sep 04 16:10:04 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:04 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b97976d-f629-4a54-bab7-857c5c9ba42e tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.edf59577-c488-4938-b1e6-035766155065" returned: 0 in 0.392s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:04 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-2b97976d-f629-4a54-bab7-857c5c9ba42e tempest-ProjectMemberTests-369224070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a24d117e-e684-4921-a3d2-0d14df0e6842(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:10:04 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a020745-01ec-42d0-b723-f658e93c881d]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:10:04 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b97976d-f629-4a54-bab7-857c5c9ba42e tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:04 devstack sudo[108449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842
Sep 04 16:10:04 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:05 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b97976d-f629-4a54-bab7-857c5c9ba42e tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842" returned: 0 in 0.380s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b97976d-f629-4a54-bab7-857c5c9ba42e tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.edf59577-c488-4938-b1e6-035766155065 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:05 devstack sudo[108454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.edf59577-c488-4938-b1e6-035766155065
Sep 04 16:10:05 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:05 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b97976d-f629-4a54-bab7-857c5c9ba42e tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.edf59577-c488-4938-b1e6-035766155065" returned: 0 in 0.400s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b97976d-f629-4a54-bab7-857c5c9ba42e tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.edf59577-c488-4938-b1e6-035766155065 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:05 devstack sudo[108459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.edf59577-c488-4938-b1e6-035766155065
Sep 04 16:10:05 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:05 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:05 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2b97976d-f629-4a54-bab7-857c5c9ba42e tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842.edf59577-c488-4938-b1e6-035766155065" returned: 0 in 0.260s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:05 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2b97976d-f629-4a54-bab7-857c5c9ba42e tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-edf59577-c488-4938-b1e6-035766155065" released by "_delete_snapshot" :: held 1.536s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:10:05 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2b97976d-f629-4a54-bab7-857c5c9ba42e tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-a24d117e-e684-4921-a3d2-0d14df0e6842" released by "delete_snapshot" :: held 1.565s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:10:05 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-2b97976d-f629-4a54-bab7-857c5c9ba42e tempest-ProjectMemberTests-369224070 None] Created reservations ['ea95741c-781a-4e8c-90d4-c1258e31c4a9', '877aae42-8e0c-4145-b7b7-c30704836424', 'de8c9184-7b33-4f5b-b309-366a2c6a8bb4', '7677e175-565f-4f17-8842-299f493cea0a'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:10:05 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-2b97976d-f629-4a54-bab7-857c5c9ba42e tempest-ProjectMemberTests-369224070 None] Delete snapshot completed successfully.
Sep 04 16:10:05 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2b97976d-f629-4a54-bab7-857c5c9ba42e tempest-ProjectMemberTests-369224070 None] Lock "cinder-edf59577-c488-4938-b1e6-035766155065-delete_snapshot" released by "delete_snapshot" :: held 1.726s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:10:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-35ea3c14-d0a5-4474-a3ce-5391c69dd95f tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-a24d117e-e684-4921-a3d2-0d14df0e6842-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:10:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-35ea3c14-d0a5-4474-a3ce-5391c69dd95f tempest-ProjectMemberTests-369224070 None] Lock "cinder-a24d117e-e684-4921-a3d2-0d14df0e6842-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:10:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-35ea3c14-d0a5-4474-a3ce-5391c69dd95f tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-a24d117e-e684-4921-a3d2-0d14df0e6842" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:10:06 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-35ea3c14-d0a5-4474-a3ce-5391c69dd95f tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-a24d117e-e684-4921-a3d2-0d14df0e6842" acquired by "delete_volume" :: waited 0.020s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:10:06 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[eceec488-edc3-4d8f-85f7-e46d29ae8591]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:10:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-35ea3c14-d0a5-4474-a3ce-5391c69dd95f tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:06 devstack sudo[108462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842
Sep 04 16:10:06 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:06 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-35ea3c14-d0a5-4474-a3ce-5391c69dd95f tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842" returned: 0 in 0.395s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:06 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-35ea3c14-d0a5-4474-a3ce-5391c69dd95f tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:06 devstack sudo[108467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842
Sep 04 16:10:06 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:07 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-35ea3c14-d0a5-4474-a3ce-5391c69dd95f tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-a24d117e-e684-4921-a3d2-0d14df0e6842" returned: 0 in 0.264s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:07 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-35ea3c14-d0a5-4474-a3ce-5391c69dd95f tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-a24d117e-e684-4921-a3d2-0d14df0e6842" released by "delete_volume" :: held 0.721s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:10:07 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-35ea3c14-d0a5-4474-a3ce-5391c69dd95f tempest-ProjectMemberTests-369224070 None] Created reservations ['cb6b708b-e6be-45cc-b4e6-6e5f00ad2621', '51ac57da-93ae-44d9-bbe5-4b5fab48e331', '1759bae1-b505-4067-a383-04edfe636b51', '0d476fd9-2df5-4e19-bad5-dd245707d4bf'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:10:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-35ea3c14-d0a5-4474-a3ce-5391c69dd95f tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:10:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-35ea3c14-d0a5-4474-a3ce-5391c69dd95f tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:10:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-35ea3c14-d0a5-4474-a3ce-5391c69dd95f tempest-ProjectMemberTests-369224070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:10:07 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-35ea3c14-d0a5-4474-a3ce-5391c69dd95f tempest-ProjectMemberTests-369224070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:10:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-35ea3c14-d0a5-4474-a3ce-5391c69dd95f tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:10:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-35ea3c14-d0a5-4474-a3ce-5391c69dd95f tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:07 devstack sudo[108470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:10:07 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:07 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:07 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-35ea3c14-d0a5-4474-a3ce-5391c69dd95f tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.241s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:07 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-35ea3c14-d0a5-4474-a3ce-5391c69dd95f tempest-ProjectMemberTests-369224070 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:10:07 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-35ea3c14-d0a5-4474-a3ce-5391c69dd95f tempest-ProjectMemberTests-369224070 None] Deleted volume successfully.
Sep 04 16:10:07 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-35ea3c14-d0a5-4474-a3ce-5391c69dd95f tempest-ProjectMemberTests-369224070 None] Lock "cinder-a24d117e-e684-4921-a3d2-0d14df0e6842-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Flow 'volume_create_manager' (45460efc-0cea-4786-8428-4b3718f043af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6efa4c57-44d0-4219-bc4c-a5a23efabdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6efa4c57-44d0-4219-bc4c-a5a23efabdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-687435505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34d5bbd-173b-419b-b3da-f3124493c7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3bec3eae6a463fbbef6576bb85077b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:08Z,use_quota=True,user_id='fccb6cabb20d46fa8276df523be9732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae76cd4-800f-4656-b392-c6e51bf92809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae76cd4-800f-4656-b392-c6e51bf92809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f878b199-38b5-4637-8699-a0a2cbf961ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f878b199-38b5-4637-8699-a0a2cbf961ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd34d5bbd-173b-419b-b3da-f3124493c7b9', 'volume_name': 'volume-d34d5bbd-173b-419b-b3da-f3124493c7b9', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df4c16aa-9369-447e-a923-f8cb8a3fdc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df4c16aa-9369-447e-a923-f8cb8a3fdc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb68812-d361-427f-bd0b-911938b36f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:10:08 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Volume d34d5bbd-173b-419b-b3da-f3124493c7b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d34d5bbd-173b-419b-b3da-f3124493c7b9', 'volume_size': 1}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-687435505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34d5bbd-173b-419b-b3da-f3124493c7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3bec3eae6a463fbbef6576bb85077b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:08Z,use_quota=True,user_id='fccb6cabb20d46fa8276df523be9732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Creating volume d34d5bbd-173b-419b-b3da-f3124493c7b9 {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:10:08 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:08 devstack sudo[108473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9 1073741824
Sep 04 16:10:08 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:08 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9 1073741824" returned: 0 in 0.429s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:08 devstack sudo[108479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9
Sep 04 16:10:08 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:08 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9" returned: 0 in 0.266s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb68812-d361-427f-bd0b-911938b36f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d34d5bbd-173b-419b-b3da-f3124493c7b9', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be77f6e-22a9-443a-aeae-3bafa9bd45c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:10:08 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Volume volume-d34d5bbd-173b-419b-b3da-f3124493c7b9 (d34d5bbd-173b-419b-b3da-f3124493c7b9): created successfully
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be77f6e-22a9-443a-aeae-3bafa9bd45c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:10:08 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Flow 'volume_create_manager' (45460efc-0cea-4786-8428-4b3718f043af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:10:08 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-78d0ed09-0884-44f6-ae16-a23d2cda4a81 tempest-ProjectMemberTests-369224070 None] Created volume successfully.
Sep 04 16:10:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fabc0879-4683-4194-a8ad-6f5cd15a3e46 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:10:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fabc0879-4683-4194-a8ad-6f5cd15a3e46 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:10:09 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-fabc0879-4683-4194-a8ad-6f5cd15a3e46 tempest-ProjectMemberTests-369224070 None] Creating offline snapshot 9b3972a7-827e-4c68-9505-c23bb95e0b06 of volume d34d5bbd-173b-419b-b3da-f3124493c7b9 {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 16:10:09 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44b2da1-ed73-47d5-8730-5c86116a0d0f]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:10:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fabc0879-4683-4194-a8ad-6f5cd15a3e46 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:09 devstack sudo[108482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9
Sep 04 16:10:09 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:09 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fabc0879-4683-4194-a8ad-6f5cd15a3e46 tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9" returned: 0 in 0.406s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:09 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fabc0879-4683-4194-a8ad-6f5cd15a3e46 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.9b3972a7-827e-4c68-9505-c23bb95e0b06 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:09 devstack sudo[108487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.9b3972a7-827e-4c68-9505-c23bb95e0b06 1G
Sep 04 16:10:09 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:10 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fabc0879-4683-4194-a8ad-6f5cd15a3e46 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.9b3972a7-827e-4c68-9505-c23bb95e0b06 1G" returned: 0 in 0.423s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fabc0879-4683-4194-a8ad-6f5cd15a3e46 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34d5bbd-173b-419b-b3da-f3124493c7b9 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.9b3972a7-827e-4c68-9505-c23bb95e0b06 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:10 devstack sudo[108493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34d5bbd-173b-419b-b3da-f3124493c7b9 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.9b3972a7-827e-4c68-9505-c23bb95e0b06
Sep 04 16:10:10 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:10 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fabc0879-4683-4194-a8ad-6f5cd15a3e46 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34d5bbd-173b-419b-b3da-f3124493c7b9 -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.9b3972a7-827e-4c68-9505-c23bb95e0b06" returned: 0 in 0.319s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:10 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-fabc0879-4683-4194-a8ad-6f5cd15a3e46 tempest-ProjectMemberTests-369224070 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.9b3972a7-827e-4c68-9505-c23bb95e0b06 is being set with open permissions: ugo+rw
Sep 04 16:10:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fabc0879-4683-4194-a8ad-6f5cd15a3e46 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.9b3972a7-827e-4c68-9505-c23bb95e0b06 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:10 devstack sudo[108498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.9b3972a7-827e-4c68-9505-c23bb95e0b06
Sep 04 16:10:10 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:10 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fabc0879-4683-4194-a8ad-6f5cd15a3e46 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.9b3972a7-827e-4c68-9505-c23bb95e0b06" returned: 0 in 0.265s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:10 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fabc0879-4683-4194-a8ad-6f5cd15a3e46 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:10 devstack sudo[108501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.info
Sep 04 16:10:10 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:11 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fabc0879-4683-4194-a8ad-6f5cd15a3e46 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.info" returned: 0 in 0.274s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:11 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-fabc0879-4683-4194-a8ad-6f5cd15a3e46 tempest-ProjectMemberTests-369224070 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.info is being set with open permissions: ugo+rw
Sep 04 16:10:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fabc0879-4683-4194-a8ad-6f5cd15a3e46 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:11 devstack sudo[108504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.info
Sep 04 16:10:11 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:11 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-fabc0879-4683-4194-a8ad-6f5cd15a3e46 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.info" returned: 0 in 0.262s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:11 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-fabc0879-4683-4194-a8ad-6f5cd15a3e46 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.042s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:10:11 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-fabc0879-4683-4194-a8ad-6f5cd15a3e46 tempest-ProjectMemberTests-369224070 None] Create snapshot completed successfully
Sep 04 16:10:12 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3e82f930-f119-4da2-a0f6-23ade7f73699 tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-9b3972a7-827e-4c68-9505-c23bb95e0b06-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:10:12 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3e82f930-f119-4da2-a0f6-23ade7f73699 tempest-ProjectMemberTests-369224070 None] Lock "cinder-9b3972a7-827e-4c68-9505-c23bb95e0b06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:10:12 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3e82f930-f119-4da2-a0f6-23ade7f73699 tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-d34d5bbd-173b-419b-b3da-f3124493c7b9" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:10:12 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3e82f930-f119-4da2-a0f6-23ade7f73699 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-d34d5bbd-173b-419b-b3da-f3124493c7b9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:10:12 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3e82f930-f119-4da2-a0f6-23ade7f73699 tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-9b3972a7-827e-4c68-9505-c23bb95e0b06" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:10:12 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3e82f930-f119-4da2-a0f6-23ade7f73699 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-9b3972a7-827e-4c68-9505-c23bb95e0b06" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:10:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-3e82f930-f119-4da2-a0f6-23ade7f73699 tempest-ProjectMemberTests-369224070 None] Deleting offline snapshot 9b3972a7-827e-4c68-9505-c23bb95e0b06 of volume d34d5bbd-173b-419b-b3da-f3124493c7b9 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 16:10:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-3e82f930-f119-4da2-a0f6-23ade7f73699 tempest-ProjectMemberTests-369224070 None] snapshot_file for this snap is: volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.9b3972a7-827e-4c68-9505-c23bb95e0b06 {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 16:10:12 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e93d95d-33fa-44e6-b040-2421844cc98a]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:10:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3e82f930-f119-4da2-a0f6-23ade7f73699 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.9b3972a7-827e-4c68-9505-c23bb95e0b06 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:12 devstack sudo[108546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.9b3972a7-827e-4c68-9505-c23bb95e0b06
Sep 04 16:10:12 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:12 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:12 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3e82f930-f119-4da2-a0f6-23ade7f73699 tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.9b3972a7-827e-4c68-9505-c23bb95e0b06" returned: 0 in 0.406s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:12 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-3e82f930-f119-4da2-a0f6-23ade7f73699 tempest-ProjectMemberTests-369224070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d34d5bbd-173b-419b-b3da-f3124493c7b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:10:13 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15c0935-2252-4ad4-b443-8a41555bc8d6]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:10:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3e82f930-f119-4da2-a0f6-23ade7f73699 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:13 devstack sudo[108551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9
Sep 04 16:10:13 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:13 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3e82f930-f119-4da2-a0f6-23ade7f73699 tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9" returned: 0 in 0.369s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3e82f930-f119-4da2-a0f6-23ade7f73699 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.9b3972a7-827e-4c68-9505-c23bb95e0b06 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:13 devstack sudo[108556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.9b3972a7-827e-4c68-9505-c23bb95e0b06
Sep 04 16:10:13 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:13 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3e82f930-f119-4da2-a0f6-23ade7f73699 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.9b3972a7-827e-4c68-9505-c23bb95e0b06" returned: 0 in 0.346s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3e82f930-f119-4da2-a0f6-23ade7f73699 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.9b3972a7-827e-4c68-9505-c23bb95e0b06 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:13 devstack sudo[108561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.9b3972a7-827e-4c68-9505-c23bb95e0b06
Sep 04 16:10:13 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:13 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:13 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-3e82f930-f119-4da2-a0f6-23ade7f73699 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9.9b3972a7-827e-4c68-9505-c23bb95e0b06" returned: 0 in 0.261s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3e82f930-f119-4da2-a0f6-23ade7f73699 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-9b3972a7-827e-4c68-9505-c23bb95e0b06" released by "_delete_snapshot" :: held 1.478s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:10:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3e82f930-f119-4da2-a0f6-23ade7f73699 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-d34d5bbd-173b-419b-b3da-f3124493c7b9" released by "delete_snapshot" :: held 1.504s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:10:14 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-3e82f930-f119-4da2-a0f6-23ade7f73699 tempest-ProjectMemberTests-369224070 None] Created reservations ['936105bc-0d11-47e2-baa8-bea45348b848', '48326626-de8a-4a77-b147-0cfd9460c1d3', '040d91eb-706a-44c8-95c3-1bfd4dfaa10d', 'c6a013ba-75ed-4e7c-81db-688c9b32d9eb'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:10:14 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-3e82f930-f119-4da2-a0f6-23ade7f73699 tempest-ProjectMemberTests-369224070 None] Delete snapshot completed successfully.
Sep 04 16:10:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-3e82f930-f119-4da2-a0f6-23ade7f73699 tempest-ProjectMemberTests-369224070 None] Lock "cinder-9b3972a7-827e-4c68-9505-c23bb95e0b06-delete_snapshot" released by "delete_snapshot" :: held 1.654s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:10:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ca28e710-8a70-4629-b3d8-db198deeb369 tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-d34d5bbd-173b-419b-b3da-f3124493c7b9-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:10:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ca28e710-8a70-4629-b3d8-db198deeb369 tempest-ProjectMemberTests-369224070 None] Lock "cinder-d34d5bbd-173b-419b-b3da-f3124493c7b9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:10:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ca28e710-8a70-4629-b3d8-db198deeb369 tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-d34d5bbd-173b-419b-b3da-f3124493c7b9" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:10:14 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ca28e710-8a70-4629-b3d8-db198deeb369 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-d34d5bbd-173b-419b-b3da-f3124493c7b9" acquired by "delete_volume" :: waited 0.014s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:10:14 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[6017ce4c-808f-4e67-8045-0463d58d36c3]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:10:14 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ca28e710-8a70-4629-b3d8-db198deeb369 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:14 devstack sudo[108565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9
Sep 04 16:10:14 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:15 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ca28e710-8a70-4629-b3d8-db198deeb369 tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9" returned: 0 in 0.360s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ca28e710-8a70-4629-b3d8-db198deeb369 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:15 devstack sudo[108570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9
Sep 04 16:10:15 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:15 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ca28e710-8a70-4629-b3d8-db198deeb369 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-d34d5bbd-173b-419b-b3da-f3124493c7b9" returned: 0 in 0.256s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ca28e710-8a70-4629-b3d8-db198deeb369 tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-d34d5bbd-173b-419b-b3da-f3124493c7b9" released by "delete_volume" :: held 0.673s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:10:15 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-ca28e710-8a70-4629-b3d8-db198deeb369 tempest-ProjectMemberTests-369224070 None] Created reservations ['f2ba017c-927e-403b-9376-5f28dba03812', '5c9f65b0-604d-44d6-921e-07dfb336a9e8', 'cfd71ab8-ad8b-46d0-858d-cbb19133ffbb', '64f4825b-67ce-4676-b987-f4f7f90dcac8'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:10:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ca28e710-8a70-4629-b3d8-db198deeb369 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:10:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ca28e710-8a70-4629-b3d8-db198deeb369 tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:10:15 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ca28e710-8a70-4629-b3d8-db198deeb369 tempest-ProjectMemberTests-369224070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:10:15 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ca28e710-8a70-4629-b3d8-db198deeb369 tempest-ProjectMemberTests-369224070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:10:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ca28e710-8a70-4629-b3d8-db198deeb369 tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:10:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ca28e710-8a70-4629-b3d8-db198deeb369 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:15 devstack sudo[108573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:10:15 devstack sudo[108573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:15 devstack sudo[108573]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:15 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ca28e710-8a70-4629-b3d8-db198deeb369 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.264s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:15 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ca28e710-8a70-4629-b3d8-db198deeb369 tempest-ProjectMemberTests-369224070 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:10:15 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-ca28e710-8a70-4629-b3d8-db198deeb369 tempest-ProjectMemberTests-369224070 None] Deleted volume successfully.
Sep 04 16:10:15 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-ca28e710-8a70-4629-b3d8-db198deeb369 tempest-ProjectMemberTests-369224070 None] Lock "cinder-d34d5bbd-173b-419b-b3da-f3124493c7b9-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:10:16 devstack cinder-volume[87504]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87504) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 16:10:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Flow 'volume_create_manager' (791bffe5-e2a8-49f2-96c8-3b61928e1972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:10:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d760ad93-dd2a-4adf-bfc6-4f6e7cf0d5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:10:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d760ad93-dd2a-4adf-bfc6-4f6e7cf0d5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1242550844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a95af8-d2b0-4557-8a0c-3cf9da01612f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3bec3eae6a463fbbef6576bb85077b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:16Z,use_quota=True,user_id='fccb6cabb20d46fa8276df523be9732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:10:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab118962-fff8-4602-95b6-bca8492dc24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:10:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab118962-fff8-4602-95b6-bca8492dc24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:10:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d96ab956-2d45-4440-aed7-5063a75aa57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:10:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d96ab956-2d45-4440-aed7-5063a75aa57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5a95af8-d2b0-4557-8a0c-3cf9da01612f', 'volume_name': 'volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:10:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8564b44-d354-4319-ac5b-d181e142a3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:10:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8564b44-d354-4319-ac5b-d181e142a3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:10:16 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533e9391-027f-4ca0-a96a-f84eab4e6cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:10:16 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Volume e5a95af8-d2b0-4557-8a0c-3cf9da01612f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f', 'volume_size': 1}
Sep 04 16:10:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:10:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:10:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77c1adaf79e0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T14:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1242550844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a95af8-d2b0-4557-8a0c-3cf9da01612f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3bec3eae6a463fbbef6576bb85077b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:16Z,use_quota=True,user_id='fccb6cabb20d46fa8276df523be9732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd8bbb3e-961e-4f78-9a5e-4b9709216f33),volume_type_id=bd8bbb3e-961e-4f78-9a5e-4b9709216f33)}" {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 16:10:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Creating volume e5a95af8-d2b0-4557-8a0c-3cf9da01612f {{(pid=87504) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 16:10:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:10:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:10:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:10:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:10:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:10:16 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Selected osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236 as target Quobyte volume. {{(pid=87504) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 16:10:16 devstack cinder-volume[87504]: INFO cinder.volume.drivers.remotefs [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] casted to osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236
Sep 04 16:10:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f 1073741824 {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:16 devstack sudo[108576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f 1073741824
Sep 04 16:10:16 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:16 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f 1073741824" returned: 0 in 0.437s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:16 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:16 devstack sudo[108582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f
Sep 04 16:10:16 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:17 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f" returned: 0 in 0.263s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:17 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'} {{(pid=87504) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 16:10:17 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:10:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533e9391-027f-4ca0-a96a-f84eab4e6cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f', 'volume_size': 1}' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:10:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (296adc92-6948-42f7-a01a-98f10f11bb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 16:10:17 devstack cinder-volume[87504]: INFO cinder.volume.flows.manager.create_volume [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Volume volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f (e5a95af8-d2b0-4557-8a0c-3cf9da01612f): created successfully
Sep 04 16:10:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (296adc92-6948-42f7-a01a-98f10f11bb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87504) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 16:10:17 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Flow 'volume_create_manager' (791bffe5-e2a8-49f2-96c8-3b61928e1972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87504) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 16:10:17 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-5a575bf3-8070-4f06-b000-ac97ebc980a4 tempest-ProjectMemberTests-369224070 None] Created volume successfully.
Sep 04 16:10:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-208f9252-bce7-4ff8-a9cc-5aaf325e7342 tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:10:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-208f9252-bce7-4ff8-a9cc-5aaf325e7342 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:10:18 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-208f9252-bce7-4ff8-a9cc-5aaf325e7342 tempest-ProjectMemberTests-369224070 None] Creating offline snapshot 0e180397-3fe6-4d42-85cc-b9e9fe3126fa of volume e5a95af8-d2b0-4557-8a0c-3cf9da01612f {{(pid=87504) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 16:10:18 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[3368453b-ac0c-4486-8abc-bcbed4ad94eb]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:10:18 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-208f9252-bce7-4ff8-a9cc-5aaf325e7342 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:18 devstack sudo[108585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f
Sep 04 16:10:18 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:19 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-208f9252-bce7-4ff8-a9cc-5aaf325e7342 tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f" returned: 0 in 0.376s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-208f9252-bce7-4ff8-a9cc-5aaf325e7342 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.0e180397-3fe6-4d42-85cc-b9e9fe3126fa 1G {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:19 devstack sudo[108590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.0e180397-3fe6-4d42-85cc-b9e9fe3126fa 1G
Sep 04 16:10:19 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:19 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-208f9252-bce7-4ff8-a9cc-5aaf325e7342 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.0e180397-3fe6-4d42-85cc-b9e9fe3126fa 1G" returned: 0 in 0.381s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-208f9252-bce7-4ff8-a9cc-5aaf325e7342 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.0e180397-3fe6-4d42-85cc-b9e9fe3126fa {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:19 devstack sudo[108596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.0e180397-3fe6-4d42-85cc-b9e9fe3126fa
Sep 04 16:10:19 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:19 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-208f9252-bce7-4ff8-a9cc-5aaf325e7342 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f -F qcow2 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.0e180397-3fe6-4d42-85cc-b9e9fe3126fa" returned: 0 in 0.301s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:19 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-208f9252-bce7-4ff8-a9cc-5aaf325e7342 tempest-ProjectMemberTests-369224070 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.0e180397-3fe6-4d42-85cc-b9e9fe3126fa is being set with open permissions: ugo+rw
Sep 04 16:10:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-208f9252-bce7-4ff8-a9cc-5aaf325e7342 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.0e180397-3fe6-4d42-85cc-b9e9fe3126fa {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:19 devstack sudo[108601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.0e180397-3fe6-4d42-85cc-b9e9fe3126fa
Sep 04 16:10:19 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:19 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:19 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-208f9252-bce7-4ff8-a9cc-5aaf325e7342 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.0e180397-3fe6-4d42-85cc-b9e9fe3126fa" returned: 0 in 0.264s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-208f9252-bce7-4ff8-a9cc-5aaf325e7342 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:20 devstack sudo[108604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.info
Sep 04 16:10:20 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:20 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-208f9252-bce7-4ff8-a9cc-5aaf325e7342 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.info" returned: 0 in 0.299s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:20 devstack cinder-volume[87504]: WARNING cinder.volume.drivers.remotefs [None req-208f9252-bce7-4ff8-a9cc-5aaf325e7342 tempest-ProjectMemberTests-369224070 None] /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.info is being set with open permissions: ugo+rw
Sep 04 16:10:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-208f9252-bce7-4ff8-a9cc-5aaf325e7342 tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.info {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:20 devstack sudo[108613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.info
Sep 04 16:10:20 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:20 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-208f9252-bce7-4ff8-a9cc-5aaf325e7342 tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.info" returned: 0 in 0.284s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-208f9252-bce7-4ff8-a9cc-5aaf325e7342 tempest-ProjectMemberTests-369224070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.990s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:10:20 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-208f9252-bce7-4ff8-a9cc-5aaf325e7342 tempest-ProjectMemberTests-369224070 None] Create snapshot completed successfully
Sep 04 16:10:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-22f9afe9-aa37-4f2c-b5b6-d3060a22810b tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-0e180397-3fe6-4d42-85cc-b9e9fe3126fa-delete_snapshot" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:10:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-22f9afe9-aa37-4f2c-b5b6-d3060a22810b tempest-ProjectMemberTests-369224070 None] Lock "cinder-0e180397-3fe6-4d42-85cc-b9e9fe3126fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:10:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-22f9afe9-aa37-4f2c-b5b6-d3060a22810b tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-e5a95af8-d2b0-4557-8a0c-3cf9da01612f" by "delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:10:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-22f9afe9-aa37-4f2c-b5b6-d3060a22810b tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-e5a95af8-d2b0-4557-8a0c-3cf9da01612f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:10:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-22f9afe9-aa37-4f2c-b5b6-d3060a22810b tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-0e180397-3fe6-4d42-85cc-b9e9fe3126fa" by "_delete_snapshot" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:10:20 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-22f9afe9-aa37-4f2c-b5b6-d3060a22810b tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-0e180397-3fe6-4d42-85cc-b9e9fe3126fa" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:10:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-22f9afe9-aa37-4f2c-b5b6-d3060a22810b tempest-ProjectMemberTests-369224070 None] Deleting offline snapshot 0e180397-3fe6-4d42-85cc-b9e9fe3126fa of volume e5a95af8-d2b0-4557-8a0c-3cf9da01612f {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 16:10:20 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-22f9afe9-aa37-4f2c-b5b6-d3060a22810b tempest-ProjectMemberTests-369224070 None] snapshot_file for this snap is: volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.0e180397-3fe6-4d42-85cc-b9e9fe3126fa {{(pid=87504) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 16:10:20 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae1f2fc-aeab-47f8-98db-91b5a4cefabe]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:10:20 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22f9afe9-aa37-4f2c-b5b6-d3060a22810b tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.0e180397-3fe6-4d42-85cc-b9e9fe3126fa {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:21 devstack sudo[108616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.0e180397-3fe6-4d42-85cc-b9e9fe3126fa
Sep 04 16:10:21 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:21 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22f9afe9-aa37-4f2c-b5b6-d3060a22810b tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.0e180397-3fe6-4d42-85cc-b9e9fe3126fa" returned: 0 in 0.400s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:21 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.remotefs [None req-22f9afe9-aa37-4f2c-b5b6-d3060a22810b tempest-ProjectMemberTests-369224070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87504) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 16:10:21 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9090f82-2e05-4655-b594-887f3d861dcb]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:10:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22f9afe9-aa37-4f2c-b5b6-d3060a22810b tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:21 devstack sudo[108621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f
Sep 04 16:10:21 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:21 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22f9afe9-aa37-4f2c-b5b6-d3060a22810b tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f" returned: 0 in 0.366s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:21 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22f9afe9-aa37-4f2c-b5b6-d3060a22810b tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.0e180397-3fe6-4d42-85cc-b9e9fe3126fa {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:21 devstack sudo[108628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.0e180397-3fe6-4d42-85cc-b9e9fe3126fa
Sep 04 16:10:21 devstack sudo[108628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:22 devstack sudo[108628]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22f9afe9-aa37-4f2c-b5b6-d3060a22810b tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.0e180397-3fe6-4d42-85cc-b9e9fe3126fa" returned: 0 in 0.334s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22f9afe9-aa37-4f2c-b5b6-d3060a22810b tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.0e180397-3fe6-4d42-85cc-b9e9fe3126fa {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:22 devstack sudo[108633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.0e180397-3fe6-4d42-85cc-b9e9fe3126fa
Sep 04 16:10:22 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:22 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:22 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-22f9afe9-aa37-4f2c-b5b6-d3060a22810b tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f.0e180397-3fe6-4d42-85cc-b9e9fe3126fa" returned: 0 in 0.252s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-22f9afe9-aa37-4f2c-b5b6-d3060a22810b tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-0e180397-3fe6-4d42-85cc-b9e9fe3126fa" released by "_delete_snapshot" :: held 1.449s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:10:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-22f9afe9-aa37-4f2c-b5b6-d3060a22810b tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-e5a95af8-d2b0-4557-8a0c-3cf9da01612f" released by "delete_snapshot" :: held 1.475s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:10:22 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-22f9afe9-aa37-4f2c-b5b6-d3060a22810b tempest-ProjectMemberTests-369224070 None] Created reservations ['3d1c9a56-e560-42c1-9c48-170bf7a60806', '36292615-a1bd-4ed5-8515-5858538c14d4', 'f810b0fb-51a2-4ab4-b29a-2b16f62bb1e6', '93b18fd5-5cdc-493c-b572-a1fdcc7a93b1'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:10:22 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-22f9afe9-aa37-4f2c-b5b6-d3060a22810b tempest-ProjectMemberTests-369224070 None] Delete snapshot completed successfully.
Sep 04 16:10:22 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-22f9afe9-aa37-4f2c-b5b6-d3060a22810b tempest-ProjectMemberTests-369224070 None] Lock "cinder-0e180397-3fe6-4d42-85cc-b9e9fe3126fa-delete_snapshot" released by "delete_snapshot" :: held 1.621s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:10:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2e61a9f5-26cf-49c3-a9e5-05d606f23c2d tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-e5a95af8-d2b0-4557-8a0c-3cf9da01612f-delete_volume" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:10:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2e61a9f5-26cf-49c3-a9e5-05d606f23c2d tempest-ProjectMemberTests-369224070 None] Lock "cinder-e5a95af8-d2b0-4557-8a0c-3cf9da01612f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:10:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2e61a9f5-26cf-49c3-a9e5-05d606f23c2d tempest-ProjectMemberTests-369224070 None] Acquiring lock "cinder-quobyte-e5a95af8-d2b0-4557-8a0c-3cf9da01612f" by "delete_volume" {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 16:10:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2e61a9f5-26cf-49c3-a9e5-05d606f23c2d tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-e5a95af8-d2b0-4557-8a0c-3cf9da01612f" acquired by "delete_volume" :: waited 0.017s {{(pid=87504) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 16:10:23 devstack cinder-volume[87504]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02b21c0-3976-425a-b7ff-fb093d5e43f1]: (4, 'qcow2') {{(pid=89071) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 16:10:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2e61a9f5-26cf-49c3-a9e5-05d606f23c2d tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:23 devstack sudo[108636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f
Sep 04 16:10:23 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:23 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2e61a9f5-26cf-49c3-a9e5-05d606f23c2d tempest-ProjectMemberTests-369224070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f" returned: 0 in 0.370s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2e61a9f5-26cf-49c3-a9e5-05d606f23c2d tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:23 devstack sudo[108641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f
Sep 04 16:10:23 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:23 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2e61a9f5-26cf-49c3-a9e5-05d606f23c2d tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce/volume-e5a95af8-d2b0-4557-8a0c-3cf9da01612f" returned: 0 in 0.237s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:23 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2e61a9f5-26cf-49c3-a9e5-05d606f23c2d tempest-ProjectMemberTests-369224070 None] Lock "cinder-quobyte-e5a95af8-d2b0-4557-8a0c-3cf9da01612f" released by "delete_volume" :: held 0.662s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:10:23 devstack cinder-volume[87504]: DEBUG cinder.quota [None req-2e61a9f5-26cf-49c3-a9e5-05d606f23c2d tempest-ProjectMemberTests-369224070 None] Created reservations ['80ae83b7-f4e8-49bb-882c-4bae6738eebb', 'ded5c4e2-18ca-4472-8582-ae88c26f1229', 'bba3a3e5-3755-4913-8f07-b0afccd54373', 'fdc4946c-9f62-4920-80c6-c847c6edd2df'] {{(pid=87504) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 16:10:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2e61a9f5-26cf-49c3-a9e5-05d606f23c2d tempest-ProjectMemberTests-369224070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:10:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2e61a9f5-26cf-49c3-a9e5-05d606f23c2d tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:10:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2e61a9f5-26cf-49c3-a9e5-05d606f23c2d tempest-ProjectMemberTests-369224070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:10:23 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-2e61a9f5-26cf-49c3-a9e5-05d606f23c2d tempest-ProjectMemberTests-369224070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:10:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-2e61a9f5-26cf-49c3-a9e5-05d606f23c2d tempest-ProjectMemberTests-369224070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:10:23 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2e61a9f5-26cf-49c3-a9e5-05d606f23c2d tempest-ProjectMemberTests-369224070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:23 devstack sudo[108644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:10:23 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:24 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:24 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-2e61a9f5-26cf-49c3-a9e5-05d606f23c2d tempest-ProjectMemberTests-369224070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.239s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:24 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-2e61a9f5-26cf-49c3-a9e5-05d606f23c2d tempest-ProjectMemberTests-369224070 None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:10:24 devstack cinder-volume[87504]: INFO cinder.volume.manager [None req-2e61a9f5-26cf-49c3-a9e5-05d606f23c2d tempest-ProjectMemberTests-369224070 None] Deleted volume successfully.
Sep 04 16:10:24 devstack cinder-volume[87504]: DEBUG cinder.coordination [None req-2e61a9f5-26cf-49c3-a9e5-05d606f23c2d tempest-ProjectMemberTests-369224070 None] Lock "cinder-e5a95af8-d2b0-4557-8a0c-3cf9da01612f-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=87504) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 16:10:37 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:SELECT=107,cinder:UPDATE=144,cinder:DELETE=10,cinder:INSERT=33 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:10:37 devstack cinder-volume[87504]: DEBUG dbcounter [-] [87504] Writing DB stats cinder:UPDATE=138,cinder:SELECT=101,cinder:INSERT=42,cinder:DELETE=14 {{(pid=87504) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 16:10:48 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 16:10:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 16:10:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 16:10:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236': None} {{(pid=87504) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 16:10:48 devstack cinder-volume[87504]: DEBUG cinder.volume.drivers.quobyte [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fa56ce6-ad14-4913-a712-beef9814e236'] {{(pid=87504) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 16:10:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.lockutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87504) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 16:10:48 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 16:10:48 devstack sudo[108656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce
Sep 04 16:10:48 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 16:10:49 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root
Sep 04 16:10:49 devstack cinder-volume[87504]: DEBUG oslo_concurrency.processutils [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fe9629329d6e924ef3e0b0b70b2b7ce" returned: 0 in 0.266s {{(pid=87504) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 16:10:49 devstack cinder-volume[87504]: DEBUG cinder.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Notifying Schedulers of capabilities ... {{(pid=87504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 16:10:49 devstack cinder-volume[87504]: DEBUG oslo_service.periodic_task [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] Running periodic task VolumeManager._thread_info {{(pid=87504) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 16:10:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread count: 28 {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 16:10:49 devstack cinder-volume[87504]: DEBUG cinder.volume.manager [None req-ab046c2b-3f09-4114-a02b-ea950b416ccd None None] thread info: [<_MainThread(MainThread, started 131673838448768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131673724603200)>, <Thread(Thread-3 (stat_writer), started daemon 131673723495936)>, <Thread(Rabbit-heartbeat, started daemon 131673723764800)>, <Thread(Thread-5 (_runner), started daemon 131673722269632)>, <Thread(Thread-7 (_runner), started daemon 131673722322112)>, <Thread(fd_logger, started daemon 131673722585024)>, <Thread(privsep_reader, started daemon 131673721593984)>, <Thread(tpool_thread_0, started daemon 131673714706112)>, <Thread(tpool_thread_1, started daemon 131673706313408)>, <Thread(tpool_thread_2, started daemon 131673697920704)>, <Thread(tpool_thread_3, started daemon 131673689528000)>, <Thread(tpool_thread_4, started daemon 131673681135296)>, <Thread(tpool_thread_5, started daemon 131673672726208)>, <Thread(tpool_thread_6, started daemon 131673664317120)>, <Thread(tpool_thread_7, started daemon 131673655908032)>, <Thread(tpool_thread_8, started daemon 131673647498944)>, <Thread(tpool_thread_9, started daemon 131673639089856)>, <Thread(tpool_thread_10, started daemon 131673630680768)>, <Thread(tpool_thread_11, started daemon 131673622271680)>, <Thread(tpool_thread_12, started daemon 131673613862592)>, <Thread(tpool_thread_13, started daemon 131673605453504)>, <Thread(tpool_thread_14, started daemon 131673597044416)>, <Thread(tpool_thread_15, started daemon 131673588635328)>, <Thread(tpool_thread_16, started daemon 131673580226240)>, <Thread(tpool_thread_17, started daemon 131673571817152)>, <Thread(tpool_thread_18, started daemon 131673563408064)>, <Thread(tpool_thread_19, started daemon 131673554998976)>] {{(pid=87504) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}